-- Logs begin at Tue 2022-08-23 15:33:11 UTC, end at Tue 2022-08-23 17:10:31 UTC. -- Aug 23 16:29:49.810835 dv-cinder-850320-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 16:29:49.819512 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 16:29:49 2022] *** Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: nodename: dv-cinder-850320-6-iscsi Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: machine: x86_64 Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: clock source: unix Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: pcre jit disabled Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: detected number of CPU cores: 4 Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: current working directory: / Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: detected binary path: /usr/bin/uwsgi-core Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: your processes number limit is 47680 Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: your memory page size is 4096 bytes Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: detected max file descriptor number: 2048 Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: lock engine: pthread robust mutexes Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: thunder lock: enabled Aug 23 16:29:49.821956 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 16:29:49.824085 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 16:29:49.862969 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: Python main interpreter initialized at 0x55d6ea5459c0 Aug 23 16:29:49.862969 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: python threads support enabled Aug 23 16:29:49.862969 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: your server socket listen backlog is limited to 100 connections Aug 23 16:29:49.862969 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: your mercy for graceful operations on workers is 90 seconds Aug 23 16:29:49.863354 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 16:29:49.863418 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: *** Operational MODE: preforking *** Aug 23 16:29:49.863867 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: *** uWSGI is running in multiple interpreter mode *** Aug 23 16:29:49.863867 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: spawned uWSGI master process (pid: 106453) Aug 23 16:29:49.868098 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: spawned uWSGI worker 1 (pid: 106474, cores: 1) Aug 23 16:29:49.868098 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: spawned uWSGI worker 2 (pid: 106475, cores: 1) Aug 23 16:29:49.868098 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 16:29:49.864077 dv-cinder-850320-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 16:29:50.556251 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 16:29:50.565209 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 16:29:51.644846 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:29:51.644846 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: from cryptography.utils import int_from_bytes Aug 23 16:29:51.645413 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:29:51.645413 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: from cryptography.utils import int_from_bytes Aug 23 16:29:51.648397 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:29:51.648397 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: from cryptography.utils import int_from_bytes Aug 23 16:29:51.648836 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:29:51.648836 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: from cryptography.utils import int_from_bytes Aug 23 16:29:54.180043 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:29:54.180635 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:29:54.180841 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:29:54.181204 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:29:54.182014 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:29:54.182119 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:29:54.182480 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:29:54.182568 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.182728 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.182826 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:29:54.183050 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.183184 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:29:54.183366 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.183473 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:29:54.183696 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.183800 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.184005 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.184102 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.184358 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.184460 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.184678 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.184768 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.185002 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.185097 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.185261 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.185355 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.185575 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.185677 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.185897 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-6-iscsi {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.185993 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.186220 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.186319 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.186474 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.186574 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.186787 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.186875 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.187105 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-6-iscsi {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.187203 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.187413 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.187514 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.187710 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.187805 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.188019 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.188133 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.188360 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.188536 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.188669 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.189826 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.189937 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190014 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190090 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190090 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190216 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190348 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190570 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190664 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190732 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190803 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190873 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.190944 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.191017 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.191094 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.191258 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.191384 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.191506 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.191652 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.191790 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.192046 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-6-iscsi {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.192216 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.192411 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.192546 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.192712 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.192841 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.193051 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.193201 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-6-iscsi {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.193408 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.193554 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.193722 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.193853 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.194054 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.194195 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.194342 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.194474 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.194670 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.194823 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.194964 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.195093 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.195265 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.195394 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.195586 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.195725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.195885 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.196012 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.196225 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.196369 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.196527 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.196668 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.196836 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.196964 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.197171 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.197310 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.197470 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.197597 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.197772 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.197899 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.198112 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.198265 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.198402 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.198536 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.198769 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.198907 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.199023 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.199211 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.199353 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.199528 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.199668 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.199799 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.199958 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.200096 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.200254 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.200393 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.200576 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.200706 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.200867 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.201008 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.201133 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.201263 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.201401 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.201527 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.201658 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.201789 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.201935 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.202093 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.202286 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.202421 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.202555 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.202680 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.202810 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.202950 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.203084 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.203252 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.203380 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.203561 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.203688 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.203878 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.204011 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.204197 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.204328 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.204531 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.204660 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.204854 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.204993 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.205127 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.205257 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.205408 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.205534 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.205744 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.205877 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.206063 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.206209 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.206343 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.206465 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.206648 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.206783 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.206969 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.207094 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.207274 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.207412 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.207571 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.207729 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.207875 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.208006 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.208235 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.208374 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.208497 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.208636 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.208784 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.208986 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.209121 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.209243 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.209372 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.209504 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.209638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.209771 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.209895 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.210017 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.210184 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.210326 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.210491 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.210682 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.210825 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.210963 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.211096 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.211218 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.211347 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.211470 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.211625 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.211753 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.211920 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.212047 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.212235 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.212443 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.212584 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.212718 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.212850 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.212980 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.213135 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.213274 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.213435 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.213573 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.213730 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.213867 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.214027 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.214155 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.214327 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.214462 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.214678 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.214819 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.214951 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.215076 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.215205 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.215338 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.215474 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.215598 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.215785 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.215920 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.216083 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.216290 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.216424 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.216552 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.216677 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.216807 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.216991 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.217119 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.217290 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.217446 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.217579 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.217708 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.217883 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.218166 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.218166 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.218505 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.218505 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.218760 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.218760 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.219156 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.219156 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.219405 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.219527 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.219659 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.219789 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.219921 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.220047 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.220250 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.220396 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.220528 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.220652 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.220830 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.220963 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.221106 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.221241 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.221366 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.221497 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.221630 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.221766 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.221900 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.222030 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.222153 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.222285 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.222494 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.222625 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.222755 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.222878 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.223000 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.223130 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.223267 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.223390 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.223513 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.223646 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.223770 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.223905 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.224035 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.224223 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.224350 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.224509 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.224695 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.224842 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:29:54.224967 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.225134 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.225262 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.225454 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.225601 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.226050 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.226180 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.226359 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.226495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.226682 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.226820 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.227008 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.227147 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.227320 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.227457 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.227626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.227758 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.227934 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.228069 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.228913 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.229039 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.229271 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.229397 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.229397 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.229628 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.229751 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.229898 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.230053 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.230189 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.230314 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.230437 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.230605 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.230739 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.230920 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.231056 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.231211 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.231338 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.231523 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.231650 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.231828 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.231966 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.232140 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.232325 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.232485 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.232692 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.232964 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.233101 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.233225 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.233349 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.233482 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.233614 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.233748 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.233871 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.234004 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.234134 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.234308 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.234445 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.234631 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.234765 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.234937 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.235073 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.235242 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.235383 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.235548 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.235685 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.235857 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.236004 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.236185 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.236330 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.236496 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.236623 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.236804 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.236938 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.237109 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.237246 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.237418 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.237545 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.237722 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.237850 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.238028 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.238170 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.238386 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.238521 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.238653 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.238784 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.239005 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.239137 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.239313 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.239436 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.239565 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.239689 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.239820 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.239944 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.240073 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.240235 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.240393 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.240522 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.240702 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.240869 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.241000 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.241123 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.241305 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.241441 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.241669 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.241798 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.241928 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.242053 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.242177 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.242310 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.242470 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.242600 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.242816 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.242958 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.243145 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.243282 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.243409 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.243532 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.243680 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.243815 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.244601 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.244741 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.244867 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.244997 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.245153 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.245281 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.245455 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.245592 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.245767 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.245906 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.246067 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.246193 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.246366 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.246494 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.246684 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.246891 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.247019 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.247210 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.247363 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.247581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.247709 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.247885 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.248017 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.248214 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.248443 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.248581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.248705 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.248827 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.249030 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.249164 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.249364 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.249493 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.249689 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.249827 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.250001 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.250136 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.250313 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.250440 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.250635 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.250764 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.250960 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.251102 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.251276 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.251453 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.251581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.251791 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.251920 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.252121 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.252284 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.252450 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.252580 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.252761 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.252966 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.253133 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.253332 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.253470 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.253594 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.253723 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.253857 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.253982 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.254104 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.254234 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.254369 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.254496 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.254627 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.254813 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.254941 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.255115 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.255240 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.255413 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.255554 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.255710 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.255845 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.256008 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.256147 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.256334 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.256496 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.256644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.256769 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.256921 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.257059 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.257226 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.257354 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.257526 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.257654 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.257824 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.257952 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.258223 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.258357 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.258559 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.258686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.258835 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.258962 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.259172 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.259302 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.259469 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.259597 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.259781 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.259908 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.260100 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.260296 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.260420 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.260543 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.260745 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.260883 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.261049 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.261202 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.261365 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.261513 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.261682 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.261852 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.261995 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.262147 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.262282 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.262460 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.262599 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.262741 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.262866 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.263075 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.263203 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.263411 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.263541 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.263679 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.263827 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.263956 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.264136 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.264286 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.264473 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.264620 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.264785 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.264913 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.265096 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.265224 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.265403 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.265540 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.265712 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.265847 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.266029 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.266164 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.266336 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.266467 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.266657 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.266789 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.266965 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.267094 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.267276 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.267437 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.267565 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.267690 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.267872 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.268006 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.268212 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.268343 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.268501 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.268712 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.268837 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.268977 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.269103 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.269305 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.269433 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.269565 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.269689 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.269821 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.269994 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.270124 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.270334 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.270460 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.270643 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.270849 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.270975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.271147 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.271277 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.271399 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.271520 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.271655 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.271820 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.271953 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.272132 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.272282 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.272466 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.272595 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.272773 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.272902 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.273136 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.273276 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.273428 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.273618 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.273745 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.273869 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.273991 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.274123 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.274261 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.274392 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.274540 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.274674 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.274842 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.274968 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.275172 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.275300 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.275484 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.275611 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.275788 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.275925 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.276086 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.276252 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.276410 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.276537 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.276717 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.276858 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.277028 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.277161 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.277330 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.277472 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.277634 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.277771 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.277936 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.278063 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.278232 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.278370 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.278530 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.278683 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.278889 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.279011 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.279153 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.279303 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.279515 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.279668 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.279794 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.279928 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.280054 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.280198 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.280337 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.280463 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.280632 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.280830 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.280962 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.281087 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.281259 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.281386 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.281533 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.281661 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.281839 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.281967 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.282144 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.282281 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.282446 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.282572 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.282751 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.282883 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.283062 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.283212 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.283403 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.283542 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.283742 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.283892 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.284027 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.284151 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.284331 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.284454 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.284576 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.284712 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.284850 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.284973 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.285158 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.285421 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.285549 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.285750 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.285879 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.286052 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.286179 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.286350 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.286478 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.286653 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.286782 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.286965 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.287099 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.287292 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.287525 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.287662 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.287851 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.287978 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.288180 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.288324 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.288495 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.288632 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.288809 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.289017 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.289155 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.289281 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.289417 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.289637 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.289790 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.289916 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.290046 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.290169 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.290300 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.290433 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.290567 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.291199 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.291402 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.291532 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.291707 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.291835 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.292009 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.292138 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.292321 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.292445 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.292633 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.292762 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.292929 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.293065 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.293233 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.293451 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.293587 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.293816 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.293816 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.294069 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.294190 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.294319 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.294450 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.294656 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.294784 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.294906 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.295027 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.295157 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.295279 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.295411 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.295526 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.295647 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.295828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.295955 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.296133 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.296302 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.296454 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.296605 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.296755 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.296892 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.297052 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.297181 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.297390 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.297520 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.297688 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.297823 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.298019 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.298156 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.298340 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.298477 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.298658 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.298784 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.298960 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.299170 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.299295 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.299416 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.299539 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.299747 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.299894 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.300021 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.300150 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.300323 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.300449 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.300581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.300706 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.300828 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.301011 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.301149 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.301288 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.301461 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.301587 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.301718 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.301881 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.302010 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.302184 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.302324 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.302483 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.302613 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.302776 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.302903 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.303079 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.303217 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.303374 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.303586 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.303728 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.303942 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.304081 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.304246 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.304375 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.304506 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.304630 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.304753 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.304884 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.305009 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.305139 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.305263 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.305415 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.305557 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.305717 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.305846 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.306014 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.306141 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.306345 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.306974 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.307202 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.307338 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.307508 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.307637 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.307813 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.307950 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.308103 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.308273 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.308418 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.308543 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.308717 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.308860 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.309024 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.309237 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.309372 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.309497 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.309620 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.309832 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.309973 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.310107 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.310235 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.310357 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.310481 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.310613 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.310765 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.310902 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.311071 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.311199 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.311380 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.311547 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.311671 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.311793 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.311961 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.312098 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.312284 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.312428 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.312584 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.312710 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.312879 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.313006 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.313176 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.313311 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.313513 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.313774 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.313911 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.314133 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.314269 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.314402 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.314527 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.314651 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.314774 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.314915 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.315048 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.315179 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.315304 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.315434 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.315564 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.315700 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.315838 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.315963 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.316093 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.316237 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.316374 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.316508 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.316686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.316816 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.316981 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.317116 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.317332 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.317469 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.317633 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.317761 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.317940 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.318067 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.318253 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.318391 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.318559 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.318696 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.318858 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.318988 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.319164 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.319370 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.319498 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.319621 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.319744 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.319952 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.320099 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.320275 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.320414 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.320540 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.320662 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.320788 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.320920 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.321054 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.321228 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.321355 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.321521 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.321649 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.321824 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.321953 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.322178 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.322305 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.322485 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.322690 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.322817 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.322940 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.323071 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.323196 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.323379 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.323517 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.323686 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.323892 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.324020 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.324250 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.324376 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.324517 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.324642 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.324766 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.324889 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.325010 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.325176 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.325314 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.325496 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.325624 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.325803 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.325950 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.326085 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.326211 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.326394 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.326529 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.326694 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.326822 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.326996 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.327123 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.327291 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.327427 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.327605 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.327741 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.327910 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.328046 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.328219 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.328358 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.328520 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.328648 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.328828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.328997 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.329123 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.329246 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.329454 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.329593 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.329788 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.330012 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.330148 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.330271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.330403 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.330540 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.330665 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.330810 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.330938 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.331117 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.331255 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.331427 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.331599 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.331727 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.331851 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.332013 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.332149 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.332342 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.332521 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.332650 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.332824 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.332951 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.333127 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.333256 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.333432 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.333568 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.333730 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.333947 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.334089 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.334305 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.334434 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.334565 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.334690 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.334813 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.334957 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.335105 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.335232 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.335409 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.335537 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.335779 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.335914 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.336076 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.336235 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.336416 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.336543 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.336744 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.336872 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.337071 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.337198 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.337477 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.338295 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.338436 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.338570 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.338696 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.338829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.338954 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.339084 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.339218 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.339363 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.339585 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.339715 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.339841 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.339964 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.340228 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.340372 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.340507 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.340632 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.340761 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.340906 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.341032 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.341155 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.341287 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.341410 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.341541 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.341709 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.341891 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.342029 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.342189 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.342325 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.342505 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.342641 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.342821 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.342959 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.343128 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.343257 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.343441 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.343576 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.343743 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.343881 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.344059 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.344242 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.344448 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.344576 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.344699 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.344836 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.344963 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.345101 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.345262 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.345427 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.345568 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.345701 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.345865 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.345993 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.346172 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.346300 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.346474 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.346611 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.346776 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.346912 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.347080 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.347215 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.347381 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.347509 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.347680 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.347808 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.347981 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.348118 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.348294 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.348487 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.348623 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.348755 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.348880 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.349012 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.349168 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.349298 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.349483 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.349624 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.349813 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.349950 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.350083 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.350286 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.350424 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.350548 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.350672 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.351058 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.351229 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.351367 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.351531 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.351667 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.351827 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.351962 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.352095 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.352279 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.352409 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.352532 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.352749 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.352894 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.353047 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.353175 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.353406 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.353542 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.353727 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.353866 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.354049 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.354178 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.354354 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.354650 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.354650 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.354897 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.355031 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.355155 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.355278 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.355409 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.355543 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.355677 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.355802 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.355932 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.356100 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.356264 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.356422 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.356558 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.356722 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.356852 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.357022 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.357158 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.357824 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.357966 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.358126 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.358259 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.358429 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.358656 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.358786 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.358910 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.359034 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.359158 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.359313 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.359449 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.359613 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.359743 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.359944 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.360081 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.360249 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.360454 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.360582 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.360706 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.360864 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.360993 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.361181 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.361311 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.361477 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.361605 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.361793 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.361960 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.362139 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.362264 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.362397 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.362528 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.362698 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.362826 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.363008 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.363137 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.363316 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.363456 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.363623 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.363759 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.363929 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.364057 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.364260 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.364402 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.364617 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.364764 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.364891 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.365125 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.365267 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.365448 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.365577 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.365755 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.365889 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.366064 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.366192 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.366372 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.366498 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.366681 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.366917 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.367054 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.367240 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.367368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.367549 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.367678 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.367856 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.367984 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.368188 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.368320 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.368497 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.368714 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.368870 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.368996 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.369121 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.369245 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.369445 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.369580 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.369705 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.369829 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.370049 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.370190 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.370317 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.370530 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.370670 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.370804 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.370935 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.371069 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.371229 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.371359 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.371543 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.371679 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.371852 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.372025 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.372181 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.372309 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.372481 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.372609 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.372816 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.372944 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.373127 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.373255 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.373428 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.373564 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.373737 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.373865 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.374045 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.374181 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.374355 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.374497 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.374731 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.374870 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.374995 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.375127 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.375251 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.375387 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.375555 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.375723 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.375869 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.375996 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.376257 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.376387 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.376512 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.376636 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.376759 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.376891 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.377072 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.377332 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.377462 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.377648 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.377777 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.377986 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.378129 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.378298 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.378432 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.378611 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.378755 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.378956 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.379127 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.379258 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.379439 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.379568 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.379769 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.379907 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.380127 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.380290 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.380416 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.380553 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.380741 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.380882 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.381012 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.381138 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.381321 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.381448 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.381630 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.381767 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.381927 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.382092 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.382232 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.382357 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.382526 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.382664 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.382825 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.383058 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.383196 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.383409 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.383546 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.383724 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.383851 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.384040 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.384291 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.384441 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.384583 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.384717 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.384934 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.385077 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.385245 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.385374 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.385558 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.385689 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.385879 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.386018 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.386199 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.386328 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.386505 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.386641 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.386806 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.386934 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.387106 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.387247 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.387412 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.387539 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.387713 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.387841 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.388021 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.388206 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.388351 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.388477 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.388640 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.388769 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.388997 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.389147 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.389290 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.389426 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.389551 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.389674 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.389807 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.389932 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.390119 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.390326 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.390455 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.390577 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.390785 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.390920 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.391044 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.391168 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.391293 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.391425 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.391563 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.391696 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.391864 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.392002 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.392225 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.392353 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.392497 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.392636 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.392764 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.392888 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.393050 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.393186 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.393356 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.393486 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.393656 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.393827 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.393963 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.394096 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.394247 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.394377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.394551 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.394688 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.394850 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.395064 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.395193 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.395317 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.395448 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.395574 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.395738 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.395884 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.396039 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.396192 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.396409 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.396541 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.396721 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.396858 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.397027 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.397276 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.397405 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.397608 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.397746 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.397925 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.398065 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.398255 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.398381 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.398563 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.398700 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.398878 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.399106 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.399245 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.399418 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.399546 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.399731 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.399860 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.400655 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.400799 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.401017 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.401161 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.401287 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.401419 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.401544 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.401667 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.401792 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.401924 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.402111 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.402276 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.402403 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.402527 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.402712 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.402850 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.403018 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.403145 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.403321 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.403448 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.403626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.403779 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.403917 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.404040 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.404246 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.404387 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.404557 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.404687 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.404862 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.404989 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.405193 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.405321 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.405541 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.405670 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.405793 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.405918 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.406041 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.406174 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.406330 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.406460 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.406639 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.406769 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.406976 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.407115 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.407284 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.407412 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.407590 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.407719 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.407897 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.408034 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.408234 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.408366 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.408542 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.408672 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.408842 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.408979 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.409220 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.409358 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.409484 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.409615 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.409753 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.409891 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.410051 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.410181 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.410357 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.410493 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.410656 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.410867 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.411071 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.411207 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.411372 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.411500 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.411686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.411815 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.411992 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.412127 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.412333 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.412469 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.412603 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.412728 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.412924 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.413060 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.413229 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.413371 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.413546 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.413674 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.413850 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.413977 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.414150 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.414287 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.414461 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.414597 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.414774 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.414916 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.415081 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.415292 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.415431 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.415563 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.415735 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.416408 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.416556 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.416684 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.416839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.416975 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.417143 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.417272 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.417445 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.417576 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.417747 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.417876 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.418054 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.418182 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.418354 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.418489 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.418659 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.418789 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.418959 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.419097 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.419335 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.419481 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.419609 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.419740 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.419865 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.419998 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.420123 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.420274 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.420451 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.420587 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.420749 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.420979 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.421133 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.421330 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.421459 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.421583 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.421707 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.421840 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.421965 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.422088 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.422212 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.422335 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.422514 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.422640 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.422753 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.422863 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.423040 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.423169 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.423337 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.423475 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.423662 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.423791 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.423987 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.424124 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.424342 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.424477 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.424659 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.424789 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.424966 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.425094 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.425350 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.425488 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.425614 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.425737 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.425886 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.426023 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.426193 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.426322 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.426499 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.426626 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.426805 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.426955 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.427115 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.427244 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.427423 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.427549 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.427728 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.427897 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.428026 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.428149 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.428342 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.428471 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.428649 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.428779 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.428955 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.429116 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.429277 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.429499 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.429641 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.429766 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.429890 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.430013 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.430242 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.430378 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.430513 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.430637 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.430790 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.430919 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.431134 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.431388 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.431522 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.431647 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.431779 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.431903 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.432027 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.432196 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.432324 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.432512 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.432651 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.432784 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.432923 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.433061 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.433228 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.433357 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.433538 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.433667 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.433844 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.434049 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.434177 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.434301 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.434455 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.434593 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.434765 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.434895 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.435088 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.435217 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.435465 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.435603 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.435746 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.435884 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.436008 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.436132 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.436347 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.436490 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.436651 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.436779 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.436904 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:29:54.437037 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.437309 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.437660 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.437943 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.438250 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.438550 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:29:54.438790 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:29:54.591196 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO dbcounter [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Registered counter for database nova_api Aug 23 16:29:54.592665 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO dbcounter [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Registered counter for database nova_api Aug 23 16:29:54.612390 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_db.sqlalchemy.engines [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:29:54.614440 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_db.sqlalchemy.engines [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:29:54.619607 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writer thread running {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:29:54.621257 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writer thread running {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:29:54.676257 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.context [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62a6c2c5-851c-4c7c-9543-0f10cb93bbf8(cell1) {{(pid=106474) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 16:29:54.678006 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.context [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62a6c2c5-851c-4c7c-9543-0f10cb93bbf8(cell1) {{(pid=106475) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 16:29:54.680119 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:29:54.680674 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:29:54.681884 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:29:54.682239 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:29:54.682341 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:29:54.682971 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:29:54.683418 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:29:54.683888 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:29:54.684634 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:29:54.685073 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:29:54.685431 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:29:54.687032 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_concurrency.lockutils [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106475) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:29:54.687410 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO dbcounter [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Registered counter for database nova_cell0 Aug 23 16:29:54.689019 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO dbcounter [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Registered counter for database nova_cell0 Aug 23 16:29:54.693031 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO dbcounter [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Registered counter for database nova_cell1 Aug 23 16:29:54.694627 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO dbcounter [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Registered counter for database nova_cell1 Aug 23 16:29:54.700923 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_db.sqlalchemy.engines [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:29:54.703830 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_db.sqlalchemy.engines [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:29:54.704606 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_db.sqlalchemy.engines [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:29:54.705712 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_db.sqlalchemy.engines [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:29:54.708698 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writer thread running {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:29:54.712194 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writer thread running {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:29:54.714269 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writer thread running {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:29:54.715212 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writer thread running {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:29:54.858384 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO dbcounter [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Registered counter for database nova_cell0 Aug 23 16:29:54.860366 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO dbcounter [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Registered counter for database nova_cell0 Aug 23 16:29:54.865498 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_db.sqlalchemy.engines [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:29:54.870017 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writer thread running {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:29:54.872107 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG oslo_db.sqlalchemy.engines [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:29:54.875420 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writer thread running {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:29:55.251328 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: WARNING keystonemiddleware.auth_token [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 16:29:55.258666 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: WARNING keystonemiddleware.auth_token [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 16:29:55.267366 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: WARNING keystonemiddleware.auth_token [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 16:29:55.274821 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: WARNING keystonemiddleware.auth_token [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 16:29:55.605813 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: WARNING keystonemiddleware.auth_token [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 16:29:55.611707 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: WARNING keystonemiddleware.auth_token [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 16:29:55.616994 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6ea5459c0 pid: 106474 (default app) Aug 23 16:29:55.619659 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:29:55.620885 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002369 Aug 23 16:29:55.621159 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: WARNING keystonemiddleware.auth_token [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 16:29:55.621298 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Tue Aug 23 16:29:55 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:29:55.627695 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: WARNING keystonemiddleware.auth_token [None req-3b9138df-6f23-4f1a-9d4d-bc04bbb4812e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 16:29:55.633264 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6ea5459c0 pid: 106475 (default app) Aug 23 16:31:20.852199 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:20.853357 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 23 16:31:20.853906 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:20.870255 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_api:SELECT=3 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:20.871407 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_cell0:SELECT=3 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:20.872254 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_cell1:SELECT=3 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:20.873090 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:21.778515 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-9a74d123-45af-4e20-ac8c-6c8caec6b603 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:21.812332 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-9a74d123-45af-4e20-ac8c-6c8caec6b603 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.951131 Aug 23 16:31:21.813280 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 23 16:31:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:31:24.207501 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:24.209725 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-abb005f8-c0f1-4bfa-93f6-48a5ccaeaca1 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003049 Aug 23 16:31:24.210428 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:24.692553 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-62da9b7d-6bca-484f-91e5-152ca21c67fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "id": "c1", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:24.712699 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:31:24.712699 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: warnings.warn(msg) Aug 23 16:31:24.817317 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-62da9b7d-6bca-484f-91e5-152ca21c67fc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.599580 Aug 23 16:31:24.824501 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:31:24.833177 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=3 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:24.834339 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_cell1:SELECT=3 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:24.835975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_cell0:SELECT=3 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:24.837080 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:25.060220 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-19c25dc1-cc39-49f8-bb11-21c1bfad421d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:25.064594 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:31:25.064594 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: warnings.warn(msg) Aug 23 16:31:25.180538 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-19c25dc1-cc39-49f8-bb11-21c1bfad421d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353447 Aug 23 16:31:25.181118 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 23 16:31:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:31:27.600538 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-62da9b7d-6bca-484f-91e5-152ca21c67fc admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:27.601859 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-62da9b7d-6bca-484f-91e5-152ca21c67fc admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Aug 23 16:31:27.602263 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:28.299052 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-c7a41c1a-35f1-4765-ae76-ce894efb356a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:28.318247 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:31:28.318247 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: warnings.warn(msg) Aug 23 16:31:28.412375 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-c7a41c1a-35f1-4765-ae76-ce894efb356a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.803243 Aug 23 16:31:28.413116 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:31:28.425041 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-64c5f466-095f-4a9d-a58c-f193b6ca5a4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:28.428428 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:31:28.428428 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: warnings.warn(msg) Aug 23 16:31:28.536589 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-64c5f466-095f-4a9d-a58c-f193b6ca5a4b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115154 Aug 23 16:31:28.537385 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 23 16:31:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:31:30.897005 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-c7a41c1a-35f1-4765-ae76-ce894efb356a admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:30.898009 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-c7a41c1a-35f1-4765-ae76-ce894efb356a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 23 16:31:30.898400 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:31:31.311352 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-909e4986-01be-4963-9459-40b520314315 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 1024, "id": "d2", "swap": 0, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:31.376011 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-909e4986-01be-4963-9459-40b520314315 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471437 Aug 23 16:31:31.376962 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 16:31:31.390078 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-a2849e7f-f1e4-45df-be7a-36da00e93d24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:31.509856 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-a2849e7f-f1e4-45df-be7a-36da00e93d24 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123316 Aug 23 16:31:31.510426 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 23 16:31:31 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:31:33.947998 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-909e4986-01be-4963-9459-40b520314315 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:33.948977 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-909e4986-01be-4963-9459-40b520314315 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 23 16:31:33.949915 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:34.396210 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-8860a30d-4f3f-473e-a6d7-ce98b0fa84ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "ram": 2048, "id": "d3", "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:34.457385 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-8860a30d-4f3f-473e-a6d7-ce98b0fa84ef admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.499729 Aug 23 16:31:34.458263 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:31:34.470489 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-ec1314b4-a77e-430e-b96e-576a5e4ca04c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:34.552989 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-ec1314b4-a77e-430e-b96e-576a5e4ca04c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086168 Aug 23 16:31:34.554013 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 23 16:31:34 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:31:36.986644 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-8860a30d-4f3f-473e-a6d7-ce98b0fa84ef admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:36.988528 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-8860a30d-4f3f-473e-a6d7-ce98b0fa84ef admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002267 Aug 23 16:31:36.990007 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:37.458276 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-4a979556-dafc-48a5-a87d-79f18d27ec03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "vcpus": 4, "name": "ds4G"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:37.569868 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-4a979556-dafc-48a5-a87d-79f18d27ec03 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.572838 Aug 23 16:31:37.571739 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:31:37.585017 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-100c3d8f-998d-47cb-baf4-55cc41ffa407 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:37.705996 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-100c3d8f-998d-47cb-baf4-55cc41ffa407 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125438 Aug 23 16:31:37.706580 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Tue Aug 23 16:31:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:31:40.158570 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-4a979556-dafc-48a5-a87d-79f18d27ec03 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:40.159503 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-4a979556-dafc-48a5-a87d-79f18d27ec03 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 23 16:31:40.159904 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:40.595671 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-604fc1f5-8632-4d56-881c-a2c73ade0805 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:40.627252 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-604fc1f5-8632-4d56-881c-a2c73ade0805 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460395 Aug 23 16:31:40.627955 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 23 16:31:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:31:43.087342 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-4a979556-dafc-48a5-a87d-79f18d27ec03 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:43.088349 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-4a979556-dafc-48a5-a87d-79f18d27ec03 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 23 16:31:43.088952 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:43.609285 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-43db0836-35a5-4a8a-8279-67c40b2673ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "1", "disk": 1, "vcpus": 1}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:43.673821 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-43db0836-35a5-4a8a-8279-67c40b2673ee admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.578586 Aug 23 16:31:43.674369 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 16:31:43.688648 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-ad7cff55-9ad4-4017-b5b3-cdd7118fd2f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:43.764456 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-ad7cff55-9ad4-4017-b5b3-cdd7118fd2f3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079557 Aug 23 16:31:43.765268 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 23 16:31:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:31:46.155123 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-43db0836-35a5-4a8a-8279-67c40b2673ee admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:46.156178 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-43db0836-35a5-4a8a-8279-67c40b2673ee admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 23 16:31:46.156583 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:46.539434 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-df08efcb-2c54-40bf-b9d4-8b6b197db0a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "vcpus": 1, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:46.635380 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-df08efcb-2c54-40bf-b9d4-8b6b197db0a4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472427 Aug 23 16:31:46.636100 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:31:46.648853 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-e4ff4ad1-b695-463d-b506-862996f5aa17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:46.717737 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-e4ff4ad1-b695-463d-b506-862996f5aa17 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073215 Aug 23 16:31:46.718320 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 23 16:31:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:31:49.062916 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-df08efcb-2c54-40bf-b9d4-8b6b197db0a4 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:49.064557 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-df08efcb-2c54-40bf-b9d4-8b6b197db0a4 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Aug 23 16:31:49.065133 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:49.555738 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-6a7f0671-0110-46e1-825f-2278d6548c25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:49.640075 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-6a7f0671-0110-46e1-825f-2278d6548c25 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.568777 Aug 23 16:31:49.644203 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 16:31:49.653161 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-d650e4fb-bbc4-4feb-ab17-41041ff9d3d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:49.735887 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-d650e4fb-bbc4-4feb-ab17-41041ff9d3d4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086034 Aug 23 16:31:49.756377 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 23 16:31:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:31:52.207814 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-6a7f0671-0110-46e1-825f-2278d6548c25 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:52.209511 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-6a7f0671-0110-46e1-825f-2278d6548c25 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002656 Aug 23 16:31:52.210084 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:52.657754 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-96ab55ed-b239-49e6-933a-f4b4d8544209 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "id": "4", "ram": 8192, "disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:52.665219 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:31:52.765129 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-96ab55ed-b239-49e6-933a-f4b4d8544209 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.548877 Aug 23 16:31:52.765959 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 16:31:52.778765 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-db38979b-dae2-4f5f-a739-6b11a53d3e46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:52.868074 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-db38979b-dae2-4f5f-a739-6b11a53d3e46 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092986 Aug 23 16:31:52.869277 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 23 16:31:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:31:55.286322 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-96ab55ed-b239-49e6-933a-f4b4d8544209 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:31:55.287472 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-96ab55ed-b239-49e6-933a-f4b4d8544209 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Aug 23 16:31:55.288220 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:31:55.846527 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-c25402b4-6bef-488d-886f-0c525816a68f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "id": "5", "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:56.700379 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-c25402b4-6bef-488d-886f-0c525816a68f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.401513 Aug 23 16:31:56.701303 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Tue Aug 23 16:31:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:31:56.713222 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-eb06a3e8-dc95-42c8-b461-4be7a44f4387 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:31:56.931293 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-eb06a3e8-dc95-42c8-b461-4be7a44f4387 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.221626 Aug 23 16:31:56.932270 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Tue Aug 23 16:31:56 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:32:15.653347 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-c25402b4-6bef-488d-886f-0c525816a68f admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:15.654371 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-c25402b4-6bef-488d-886f-0c525816a68f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 23 16:32:15.654799 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:32:16.093085 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-35fb446f-9a72-4e48-9545-767b751ee1f6 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:16.112802 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-35fb446f-9a72-4e48-9545-767b751ee1f6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.451000 Aug 23 16:32:16.113627 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 23 16:32:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:32:17.218556 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-c25402b4-6bef-488d-886f-0c525816a68f admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:17.219653 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-c25402b4-6bef-488d-886f-0c525816a68f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 23 16:32:17.220336 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:32:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:32:17.825408 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-00f42184-3f78-49a8-b23d-095258008ce9 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:17.833831 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.wsgi [None req-00f42184-3f78-49a8-b23d-095258008ce9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-00f42184-3f78-49a8-b23d-095258008ce9 admin admin] Request method failure captured: Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Accept: application/json Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Accept-Encoding: gzip, deflate Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Connection: keep-alive Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Content-Length: 0 Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Host: 10.222.0.52 Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Openstack-Api-Version: compute 2.90 Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Openstack-System-Scope: None Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: User-Agent: python-novaclient Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Auth-Token: gAAAAABjBQERt3vvjrIf8K6YMWcYINrqoh6IcoV4b46sQ1341VhoCYsqCmuiPgSvg6oQ9W-6LXibjAgJ-GR3fIkUB35KlNjpXyfBEGzjRvodqUButegSKzVy8zK3_r0LrjziyTaqY5shu3PCqwr59l_q0ycD5XvSSSZIBKnxNh5pYKcB75560G0 Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Domain-Id: None Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Domain-Name: None Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Identity-Status: Confirmed Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Is-Admin-Project: True Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Domain-Id: default Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Domain-Name: Default Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Name: admin Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Role: admin,member,reader Aug 23 16:32:17.837271 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Roles: admin,member,reader Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3dbbd4392a0437abd4dab870550ff83", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Tenant: admin Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Tenant-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Tenant-Name: admin Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User: admin Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Domain-Id: default Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Domain-Name: Default Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Id: 8345551cf7d04b1abb1879afe864846c Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Name: admin Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: method: > Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: exception: Flavor 42 could not be found. Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: action_args: {'id': '42'} Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:32:17.838829 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:17.839686 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.840922 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-00f42184-3f78-49a8-b23d-095258008ce9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:32:17.841943 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-00f42184-3f78-49a8-b23d-095258008ce9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.462325 Aug 23 16:32:17.841943 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 23 16:32:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 464 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:17.849817 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-e5ee46ec-80ab-489b-b3fc-62a460bcb191 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:17.854426 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:32:17.874069 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-e5ee46ec-80ab-489b-b3fc-62a460bcb191 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028575 Aug 23 16:32:17.874851 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 23 16:32:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:32:17.884906 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-d52e8240-8d48-4ec1-a173-33f9d44d436c admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:17.911742 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-d52e8240-8d48-4ec1-a173-33f9d44d436c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030391 Aug 23 16:32:17.912253 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 23 16:32:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:32:17.922068 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-37588941-38c1-4a59-b29f-703736eff79f admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:17.928132 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.wsgi [None req-37588941-38c1-4a59-b29f-703736eff79f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-37588941-38c1-4a59-b29f-703736eff79f admin admin] Request method failure captured: Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Accept: application/json Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Accept-Encoding: gzip, deflate Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Connection: keep-alive Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Content-Length: 0 Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Host: 10.222.0.52 Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Openstack-Api-Version: compute 2.90 Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Openstack-System-Scope: None Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: User-Agent: python-novaclient Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Auth-Token: gAAAAABjBQERt3vvjrIf8K6YMWcYINrqoh6IcoV4b46sQ1341VhoCYsqCmuiPgSvg6oQ9W-6LXibjAgJ-GR3fIkUB35KlNjpXyfBEGzjRvodqUButegSKzVy8zK3_r0LrjziyTaqY5shu3PCqwr59l_q0ycD5XvSSSZIBKnxNh5pYKcB75560G0 Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Domain-Id: None Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Domain-Name: None Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Identity-Status: Confirmed Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Is-Admin-Project: True Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Domain-Id: default Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Domain-Name: Default Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Name: admin Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Role: admin,member,reader Aug 23 16:32:17.931981 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Roles: admin,member,reader Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3dbbd4392a0437abd4dab870550ff83", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Tenant: admin Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Tenant-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Tenant-Name: admin Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User: admin Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Domain-Id: default Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Domain-Name: Default Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Id: 8345551cf7d04b1abb1879afe864846c Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Name: admin Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: method: > Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: exception: Flavor 42 could not be found. Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: action_args: {'id': '42'} Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:32:17.933571 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:17.934622 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:17.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-37588941-38c1-4a59-b29f-703736eff79f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:32:17.937615 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-37588941-38c1-4a59-b29f-703736eff79f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015036 Aug 23 16:32:17.937615 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 23 16:32:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:18.953093 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-d52e8240-8d48-4ec1-a173-33f9d44d436c admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:18.954213 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-d52e8240-8d48-4ec1-a173-33f9d44d436c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Aug 23 16:32:18.954595 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:32:19.576780 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-0c37b03a-1047-4d3e-bea1-39d30a99c055 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:19.582807 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.wsgi [None req-0c37b03a-1047-4d3e-bea1-39d30a99c055 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-0c37b03a-1047-4d3e-bea1-39d30a99c055 admin admin] Request method failure captured: Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Accept: application/json Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Accept-Encoding: gzip, deflate Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Connection: keep-alive Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Content-Length: 0 Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Host: 10.222.0.52 Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Openstack-Api-Version: compute 2.90 Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Openstack-System-Scope: None Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: User-Agent: python-novaclient Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Auth-Token: gAAAAABjBQESncr3I9GWG0Xw8AlDANq459zsEWl1bcSNQMmhd-Y2E_Si1lhKgv2j2AQjLEcLmOQ673otB7YVb5KI8i186XXGIcsOsBX7an3AKznEfbg60I7AcODmAcmIgy-dFkN-rLSvNFR9nP5z4Z55IsPa4YfpEC7Au4t5MMiYbkV_Aua05ak Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Domain-Id: None Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Domain-Name: None Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Identity-Status: Confirmed Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Is-Admin-Project: True Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Domain-Id: default Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Domain-Name: Default Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Name: admin Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Role: admin,member,reader Aug 23 16:32:19.584368 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Roles: admin,member,reader Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3dbbd4392a0437abd4dab870550ff83", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Tenant: admin Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Tenant-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Tenant-Name: admin Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User: admin Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Domain-Id: default Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Domain-Name: Default Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Id: 8345551cf7d04b1abb1879afe864846c Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Name: admin Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: method: > Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: exception: Flavor 84 could not be found. Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: action_args: {'id': '84'} Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:32:19.585638 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:19.586581 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.587839 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-0c37b03a-1047-4d3e-bea1-39d30a99c055 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:32:19.589300 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-0c37b03a-1047-4d3e-bea1-39d30a99c055 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.489166 Aug 23 16:32:19.589300 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 23 16:32:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 490 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:19.595550 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-f0673467-8fff-45f9-aeb2-938e36f77da9 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:19.611433 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-f0673467-8fff-45f9-aeb2-938e36f77da9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019459 Aug 23 16:32:19.611991 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 23 16:32:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:32:19.621828 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-79dc298a-b5ec-4024-b751-96a9b4832605 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:19.637634 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-79dc298a-b5ec-4024-b751-96a9b4832605 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019293 Aug 23 16:32:19.640284 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 23 16:32:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:32:19.648319 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-7663cb2c-c9d7-4347-a8b1-273259a01245 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:19.653894 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.wsgi [None req-7663cb2c-c9d7-4347-a8b1-273259a01245 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-7663cb2c-c9d7-4347-a8b1-273259a01245 admin admin] Request method failure captured: Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Accept: application/json Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Accept-Encoding: gzip, deflate Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Connection: keep-alive Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Content-Length: 0 Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Host: 10.222.0.52 Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Openstack-Api-Version: compute 2.90 Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Openstack-System-Scope: None Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: User-Agent: python-novaclient Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Auth-Token: gAAAAABjBQESncr3I9GWG0Xw8AlDANq459zsEWl1bcSNQMmhd-Y2E_Si1lhKgv2j2AQjLEcLmOQ673otB7YVb5KI8i186XXGIcsOsBX7an3AKznEfbg60I7AcODmAcmIgy-dFkN-rLSvNFR9nP5z4Z55IsPa4YfpEC7Au4t5MMiYbkV_Aua05ak Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Domain-Id: None Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Domain-Name: None Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Identity-Status: Confirmed Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Is-Admin-Project: True Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Domain-Id: default Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Domain-Name: Default Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Name: admin Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Role: admin,member,reader Aug 23 16:32:19.655461 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Roles: admin,member,reader Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3dbbd4392a0437abd4dab870550ff83", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Tenant: admin Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Tenant-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Tenant-Name: admin Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User: admin Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Domain-Id: default Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Domain-Name: Default Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Id: 8345551cf7d04b1abb1879afe864846c Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Name: admin Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: method: > Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: exception: Flavor 84 could not be found. Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: action_args: {'id': '84'} Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:32:19.656828 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:19.657644 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:19.658756 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-7663cb2c-c9d7-4347-a8b1-273259a01245 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:32:19.659764 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-7663cb2c-c9d7-4347-a8b1-273259a01245 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012159 Aug 23 16:32:19.659764 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Tue Aug 23 16:32:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:20.671546 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-79dc298a-b5ec-4024-b751-96a9b4832605 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:20.672579 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-79dc298a-b5ec-4024-b751-96a9b4832605 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 23 16:32:20.672971 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:32:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:32:21.274580 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-6be8ca6d-8af0-4ee5-bf79-01ba71e311c5 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:21.280749 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.wsgi [None req-6be8ca6d-8af0-4ee5-bf79-01ba71e311c5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-6be8ca6d-8af0-4ee5-bf79-01ba71e311c5 admin admin] Request method failure captured: Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Accept: application/json Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Accept-Encoding: gzip, deflate Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Connection: keep-alive Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Content-Length: 0 Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Host: 10.222.0.52 Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Openstack-Api-Version: compute 2.90 Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Openstack-System-Scope: None Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: User-Agent: python-novaclient Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Auth-Token: gAAAAABjBQEUs0yH0dyZZxwk63B9J0NB8H5jwk-0E0F07y5xK5l12OVboSlwrAB2TTCRnKRvLt3tsXMQTPs-SIQu7OhWa8JU6Tpv2c9A7VD4UGqgHLQNYLPLFWAkOuHqvYplyIah1PiJ7oVatUiGlv-pKbQQeewwIO2o0S6hN_9Wzi7hIvOuNLE Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Domain-Id: None Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Domain-Name: None Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Identity-Status: Confirmed Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Is-Admin-Project: True Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Domain-Id: default Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Domain-Name: Default Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Project-Name: admin Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Role: admin,member,reader Aug 23 16:32:21.282297 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Roles: admin,member,reader Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3dbbd4392a0437abd4dab870550ff83", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Tenant: admin Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Tenant-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-Tenant-Name: admin Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User: admin Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Domain-Id: default Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Domain-Name: Default Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Id: 8345551cf7d04b1abb1879afe864846c Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: X-User-Name: admin Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: method: > Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: exception: Flavor 451 could not be found. Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: action_args: {'id': '451'} Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:32:21.283626 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:21.284524 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.285725 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-6be8ca6d-8af0-4ee5-bf79-01ba71e311c5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106475) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:32:21.286932 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-6be8ca6d-8af0-4ee5-bf79-01ba71e311c5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.474125 Aug 23 16:32:21.288299 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 23 16:32:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 479 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 16:32:21.294953 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-8699e5d6-4f1f-441c-b5db-41875ce4c2cd admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:21.317193 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-8699e5d6-4f1f-441c-b5db-41875ce4c2cd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026816 Aug 23 16:32:21.317764 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 23 16:32:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:32:21.327977 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:21.344622 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020266 Aug 23 16:32:21.345196 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Tue Aug 23 16:32:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:32:21.355417 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-f846f171-d4e6-4097-888e-34c7ee327fc1 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:21.360976 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.wsgi [None req-f846f171-d4e6-4097-888e-34c7ee327fc1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-f846f171-d4e6-4097-888e-34c7ee327fc1 admin admin] Request method failure captured: Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Accept: application/json Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Accept-Encoding: gzip, deflate Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Connection: keep-alive Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Content-Length: 0 Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Host: 10.222.0.52 Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Openstack-Api-Version: compute 2.90 Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Openstack-System-Scope: None Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: User-Agent: python-novaclient Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Auth-Token: gAAAAABjBQEUs0yH0dyZZxwk63B9J0NB8H5jwk-0E0F07y5xK5l12OVboSlwrAB2TTCRnKRvLt3tsXMQTPs-SIQu7OhWa8JU6Tpv2c9A7VD4UGqgHLQNYLPLFWAkOuHqvYplyIah1PiJ7oVatUiGlv-pKbQQeewwIO2o0S6hN_9Wzi7hIvOuNLE Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Domain-Id: None Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Domain-Name: None Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Identity-Status: Confirmed Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Is-Admin-Project: True Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Domain-Id: default Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Domain-Name: Default Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Project-Name: admin Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Role: admin,member,reader Aug 23 16:32:21.362975 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Roles: admin,member,reader Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c3dbbd4392a0437abd4dab870550ff83", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c3dbbd4392a0437abd4dab870550ff83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Tenant: admin Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Tenant-Id: c3dbbd4392a0437abd4dab870550ff83 Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-Tenant-Name: admin Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User: admin Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Domain-Id: default Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Domain-Name: Default Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Id: 8345551cf7d04b1abb1879afe864846c Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: X-User-Name: admin Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: method: > Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: exception: Flavor 451 could not be found. Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: action_args: {'id': '451'} Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:32:21.364660 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:21.365495 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: ERROR nova.api.openstack.wsgi Aug 23 16:32:21.366548 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-f846f171-d4e6-4097-888e-34c7ee327fc1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106474) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:32:21.367522 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-f846f171-d4e6-4097-888e-34c7ee327fc1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012669 Aug 23 16:32:21.367522 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 23 16:32:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 16:32:22.369177 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:22.370189 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 23 16:32:22.370659 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:32:22.910288 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-c053ef11-e188-4a67-a4cd-1d1d404fe0cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:32:22.993443 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-c053ef11-e188-4a67-a4cd-1d1d404fe0cd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.481034 Aug 23 16:32:22.994007 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 23 16:32:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:32:23.975265 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:23.976577 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001782 Aug 23 16:32:23.976980 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:32:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:32:24.513481 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-fd8446e4-ed95-4ee7-8117-008283d8a546 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:32:24.592047 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-fd8446e4-ed95-4ee7-8117-008283d8a546 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.467583 Aug 23 16:32:24.592634 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 23 16:32:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:32:25.572642 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:25.573660 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 23 16:32:25.574060 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:32:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:32:26.121149 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-25773afd-aed8-429a-9db3-1ee87d12d6e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:32:26.215217 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-25773afd-aed8-429a-9db3-1ee87d12d6e9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.500228 Aug 23 16:32:26.215776 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 23 16:32:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:32:27.204515 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:27.206448 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 23 16:32:27.206743 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:32:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:32:27.738630 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-d41a3439-c4b8-4cb5-a0bb-c07435759bfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:32:27.871984 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-d41a3439-c4b8-4cb5-a0bb-c07435759bfa admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.523339 Aug 23 16:32:27.872492 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Tue Aug 23 16:32:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:32:28.860581 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:28.861594 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 23 16:32:28.861992 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:32:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:32:29.382523 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-4c9bd167-5c4b-41cd-8179-8137cad647ae admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:32:29.403017 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-4c9bd167-5c4b-41cd-8179-8137cad647ae admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404266 Aug 23 16:32:29.403550 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Tue Aug 23 16:32:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:33:23.173071 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:33:23.173996 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-798a182d-ab81-4a0c-ba14-aae1170912c0 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Aug 23 16:33:23.174676 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Tue Aug 23 16:33:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:33:23.185643 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:33:23.578262 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-1278b80b-a855-49eb-8a6b-2b1997bedc25 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:33:23.599162 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-1278b80b-a855-49eb-8a6b-2b1997bedc25 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.418275 Aug 23 16:33:23.599710 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Tue Aug 23 16:33:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:33:23.622163 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG dbcounter [-] [106475] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:33:23.626377 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-895c9875-ad0c-48cc-a197-77117b48ce85 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:33:23.634130 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-895c9875-ad0c-48cc-a197-77117b48ce85 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013377 Aug 23 16:33:23.639280 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Aug 23 16:33:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:33:23.647361 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-b7b8ec21-5459-482f-a3fa-22e9cf4250de admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:33:23.655327 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-b7b8ec21-5459-482f-a3fa-22e9cf4250de admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011713 Aug 23 16:33:23.655840 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Aug 23 16:33:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:33:23.667495 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:33:23.675510 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011912 Aug 23 16:33:23.676038 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Tue Aug 23 16:33:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:33:23.687949 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-8e315378-e3de-4a54-a109-0ca5f0cc9ac5 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:33:23.695558 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-8e315378-e3de-4a54-a109-0ca5f0cc9ac5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011739 Aug 23 16:33:23.696077 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Tue Aug 23 16:33:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:36:35.128008 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:36:35.129056 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 23 16:36:35.129452 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:36:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:36:35.270173 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=6 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:35.431813 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-b3c64fe4-894b-46ed-8268-3d545cc65524 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:36:35.434145 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:36:35.434145 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: warnings.warn(msg) Aug 23 16:36:35.435260 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-b3c64fe4-894b-46ed-8268-3d545cc65524 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:36:35.435736 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-b3c64fe4-894b-46ed-8268-3d545cc65524 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:36:35.436205 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-b3c64fe4-894b-46ed-8268-3d545cc65524 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:36:35.436888 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-b3c64fe4-894b-46ed-8268-3d545cc65524 admin admin] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:36:35.437333 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-b3c64fe4-894b-46ed-8268-3d545cc65524 admin admin] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:36:35.437744 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-b3c64fe4-894b-46ed-8268-3d545cc65524 admin admin] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:36:35.471776 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-b3c64fe4-894b-46ed-8268-3d545cc65524 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203048 Aug 23 16:36:35.472386 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 23 16:36:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:36:36.325060 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:36:36.326065 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 23 16:36:36.326463 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:36:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:36:36.532814 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-e537932f-6e51-4005-9576-2229cc76680d admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:36:36.535096 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:36:36.535096 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: warnings.warn(msg) Aug 23 16:36:36.536233 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-e537932f-6e51-4005-9576-2229cc76680d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:36:36.536710 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-e537932f-6e51-4005-9576-2229cc76680d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:36:36.537137 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-e537932f-6e51-4005-9576-2229cc76680d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:36:36.537844 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-e537932f-6e51-4005-9576-2229cc76680d admin admin] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:36:36.538383 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-e537932f-6e51-4005-9576-2229cc76680d admin admin] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:36:36.538857 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-e537932f-6e51-4005-9576-2229cc76680d admin admin] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:36:36.558479 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-e537932f-6e51-4005-9576-2229cc76680d admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080988 Aug 23 16:36:36.559046 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 23 16:36:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:36:47.813109 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:36:47.814174 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 23 16:36:47.814580 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:36:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:36:47.956391 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_cell0:SELECT=4 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:47.957015 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_cell1:SELECT=4 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:47.957620 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG dbcounter [-] [106474] Writing DB stats nova_api:SELECT=8 {{(pid=106474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:36:48.006921 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-82cce1d2-21c2-4ced-ad98-1c7cca27b52b admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:36:48.010470 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:36:48.010470 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: warnings.warn(msg) Aug 23 16:36:48.010655 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-82cce1d2-21c2-4ced-ad98-1c7cca27b52b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:36:48.011049 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-82cce1d2-21c2-4ced-ad98-1c7cca27b52b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:36:48.011485 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-82cce1d2-21c2-4ced-ad98-1c7cca27b52b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:36:48.012229 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-82cce1d2-21c2-4ced-ad98-1c7cca27b52b admin admin] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:36:48.012681 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-82cce1d2-21c2-4ced-ad98-1c7cca27b52b admin admin] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:36:48.013103 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-82cce1d2-21c2-4ced-ad98-1c7cca27b52b admin admin] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:36:48.037898 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-82cce1d2-21c2-4ced-ad98-1c7cca27b52b admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085924 Aug 23 16:36:48.038451 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 23 16:36:47 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:36:48.880204 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: DEBUG nova.api.openstack.wsgi [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] Calling method '>' {{(pid=106475) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:36:48.880204 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: INFO nova.api.openstack.requestlog [None req-ad1f5374-14ca-445e-9347-090709141802 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 23 16:36:48.880204 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: [pid: 106475|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Tue Aug 23 16:36:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:36:49.070814 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG nova.api.openstack.wsgi [None req-6ccc1d29-5624-4887-a5ac-471ddd30efe0 admin admin] Calling method '>' {{(pid=106474) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:36:49.073202 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 16:36:49.073202 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: warnings.warn(msg) Aug 23 16:36:49.074305 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-6ccc1d29-5624-4887-a5ac-471ddd30efe0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:36:49.074782 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-6ccc1d29-5624-4887-a5ac-471ddd30efe0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:36:49.075208 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-6ccc1d29-5624-4887-a5ac-471ddd30efe0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:36:49.075936 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-6ccc1d29-5624-4887-a5ac-471ddd30efe0 admin admin] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:36:49.076408 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-6ccc1d29-5624-4887-a5ac-471ddd30efe0 admin admin] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:36:49.076824 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: DEBUG oslo_concurrency.lockutils [None req-6ccc1d29-5624-4887-a5ac-471ddd30efe0 admin admin] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106474) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:36:49.098608 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: INFO nova.api.openstack.requestlog [None req-6ccc1d29-5624-4887-a5ac-471ddd30efe0 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080613 Aug 23 16:36:49.099148 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: [pid: 106474|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Tue Aug 23 16:36:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:37:47.313755 dv-cinder-850320-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 23 16:37:47.314482 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: Tue Aug 23 16:37:47 2022 - graceful shutdown triggered... Aug 23 16:37:47.314935 dv-cinder-850320-6-iscsi devstack@n-api.service[106474]: Gracefully killing worker 1 (pid: 106474)... Aug 23 16:37:47.315306 dv-cinder-850320-6-iscsi devstack@n-api.service[106475]: Gracefully killing worker 2 (pid: 106475)... Aug 23 16:37:48.315479 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: worker 1 buried after 1 seconds Aug 23 16:37:48.316087 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: worker 2 buried after 1 seconds Aug 23 16:37:48.316087 dv-cinder-850320-6-iscsi devstack@n-api.service[106453]: goodbye to uWSGI. Aug 23 16:37:48.317101 dv-cinder-850320-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 23 16:37:48.317654 dv-cinder-850320-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 23 16:37:48.320523 dv-cinder-850320-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 16:37:48.331523 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 16:37:48 2022] *** Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: nodename: dv-cinder-850320-6-iscsi Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: machine: x86_64 Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: clock source: unix Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: pcre jit disabled Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: detected number of CPU cores: 4 Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: current working directory: / Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: detected binary path: /usr/bin/uwsgi-core Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: your processes number limit is 47680 Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: your memory page size is 4096 bytes Aug 23 16:37:48.333621 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: detected max file descriptor number: 2048 Aug 23 16:37:48.334909 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: lock engine: pthread robust mutexes Aug 23 16:37:48.334909 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: thunder lock: enabled Aug 23 16:37:48.334909 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 16:37:48.334909 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 16:37:48.375820 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: Python main interpreter initialized at 0x5632d6b499c0 Aug 23 16:37:48.375820 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: python threads support enabled Aug 23 16:37:48.375820 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: your server socket listen backlog is limited to 100 connections Aug 23 16:37:48.375820 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: your mercy for graceful operations on workers is 90 seconds Aug 23 16:37:48.376248 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 16:37:48.376321 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: *** Operational MODE: preforking *** Aug 23 16:37:48.376598 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: *** uWSGI is running in multiple interpreter mode *** Aug 23 16:37:48.376598 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: spawned uWSGI master process (pid: 133176) Aug 23 16:37:48.376811 dv-cinder-850320-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 16:37:48.377366 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: spawned uWSGI worker 1 (pid: 133198, cores: 1) Aug 23 16:37:48.377969 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: spawned uWSGI worker 2 (pid: 133199, cores: 1) Aug 23 16:37:48.378265 dv-cinder-850320-6-iscsi devstack@n-api.service[133176]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 16:37:49.053443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 16:37:49.065806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 16:37:50.203776 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:37:50.203776 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: from cryptography.utils import int_from_bytes Aug 23 16:37:50.204475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:37:50.204475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: from cryptography.utils import int_from_bytes Aug 23 16:37:50.244883 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:37:50.244883 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: from cryptography.utils import int_from_bytes Aug 23 16:37:50.245480 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 16:37:50.245480 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: from cryptography.utils import int_from_bytes Aug 23 16:37:52.621768 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:37:52.622360 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:37:52.622582 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:37:52.622955 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:37:52.623209 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:37:52.623603 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.623939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.624309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.624629 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.625131 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.625450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.625784 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.626111 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.626449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.626716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.627045 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.627383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-6-iscsi {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.627712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.628029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.628469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.628702 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.629015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.629342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.629757 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.630254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.632058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.632058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.632058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.632058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.632058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.632511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.642676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.642676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.642676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.642676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.642676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-6-iscsi {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.642676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.642676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.642676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.643469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.643469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.643469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.643469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.643469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.643469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.643469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.643469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.644644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.645907 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.646060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.646370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.646694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.647114 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.647369 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.647680 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.648026 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.648431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.654403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.654403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.654403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.654403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.654403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.654403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.654403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.654403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.655646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.655646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.655646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.655646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.655646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.655646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.655646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.655646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.657534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.657534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.657534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.657534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.657534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.657534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.657534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.657534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.658669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.658669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.658669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.658669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.658669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.658669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.658669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.658669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.659875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.659875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.659875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.659875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.660468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.660468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.660867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.661143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.661365 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.661688 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.661993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.662305 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.662623 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.662934 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.663479 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.663727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.663925 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.664586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.664586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.664903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.665106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.665370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.665775 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.666576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.666896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.667212 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.667525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.667856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.668239 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.668566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.668916 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.669238 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.669579 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.669913 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.670237 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.670555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.670877 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.671349 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.671510 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.671826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.672141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.672507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.672830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.673167 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.673571 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.673954 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.674106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.674756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.674756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.675097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.675509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.675731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.676079 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.676459 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.676830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.677134 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.677465 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.677789 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.678107 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.678424 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.678753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.679092 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.679424 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.679737 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.680058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.680404 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.680723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.681048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.681522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.681745 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.682068 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.684866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.684866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.684866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.684866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.684866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.684866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.684866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.684866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.686903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.686903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.686903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.686903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.686903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.686903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.686903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.688462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.688462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.688462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.688462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.688462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.689486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.689486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.689486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.689897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.689897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.691655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.691655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.691655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.691655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.691655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.693021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.693021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.693021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.693021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.693021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.693794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.693794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.694221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.694221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.694531 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.695976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.695976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.695976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.695976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.696616 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.696616 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.696895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.697141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.697303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.700226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.700226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.700226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.700226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.700226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.700226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.700226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.700226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.701462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.701462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.701462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.701462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.701462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.702155 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.702155 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.702427 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.702583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.702815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.703178 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.703449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.703765 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.704081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.704220 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 16:37:52.704621 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 16:37:52.704703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.704777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.704999 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 16:37:52.705110 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.705359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.705458 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 16:37:52.705604 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 16:37:52.705721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.705978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.706102 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.706301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.706402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.706614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.706725 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.706932 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.707042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.707272 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.707455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.707634 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.707757 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.707931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.708179 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.708294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.708583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.708743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.708898 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.709155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.709258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.709433 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.709533 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.709763 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.709930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.710094 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850320-6-iscsi {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.710209 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.710414 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.710548 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.710730 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.710875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.711074 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.711209 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.711359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.711482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.711682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.711890 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.712014 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.712207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.713524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.713626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.713701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.713701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.713854 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.713942 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.714021 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.714271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.714447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.714603 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.714765 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.714917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.715206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.715393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.715393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.715689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.715842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.716005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.716200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.716351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.716495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.716675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.716837 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.717004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.717148 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.717311 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.717504 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.717798 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.717967 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.718122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.718375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850320-6-iscsi {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.718535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.718695 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.718861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.719026 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.719189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.719337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.719519 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.719682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.720518 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.720687 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.720857 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.721003 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.721179 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.721330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.721481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.721481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.721806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.721957 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.722109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.722261 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.722434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.722656 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.722964 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.723154 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.723326 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.723492 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.723645 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.723797 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.723797 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.724069 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.724248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.724450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.724598 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.725003 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.725166 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.725324 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.725469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.725469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.725469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.726768 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.726914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.727066 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.727219 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.727363 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.727507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.727668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.727852 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.728015 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.729116 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.729272 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.729431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.729431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.729797 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.729977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.729977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.730301 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.730479 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.730654 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.730856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.731010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.731163 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.731307 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.731469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.731620 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.731940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.732346 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.732499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.732658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.733003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.733165 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.733165 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.734551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.734551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.734551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.734551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.735196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.735350 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.735502 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.735653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.735816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.736005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.736219 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.736385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.736385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.736668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.736825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.736978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.737178 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.737328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.737479 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.737637 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.737788 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.737939 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.738092 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.738092 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.738486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.738486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.738486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.738486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.739057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.739246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.739402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.739560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.739706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.739849 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.739991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.740142 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.740322 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.740467 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.740618 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.740776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.740924 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.741079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.741267 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.741417 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.741569 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.741720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.741892 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.742195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.742195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.742195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.742195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.742195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.742195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.743716 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.743716 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.743716 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.743716 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.743716 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.748251 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.748426 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.748616 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.748867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.749091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.749319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.749516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.749677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.749831 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.750064 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.750248 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.750410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.751218 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.751403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.751563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.751563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.751898 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.752050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.752329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.752513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.752833 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.753035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.753499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.753666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.753977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.754777 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.754940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.755088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.755253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.755448 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.755593 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.755745 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.755891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.756049 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.756229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.756388 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.756880 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.757038 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.757184 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.757381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.757533 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.757685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.758794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.758989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.759156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.759316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.760112 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.765172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.765383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.765541 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.765701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.765875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.766025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.766181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.766335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.766489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.766642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.766793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.766944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.767095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.767252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.767404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.767557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.767708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.767851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.768047 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.768312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.768504 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.768664 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.768818 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.768970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.769121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.769301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.769457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.769611 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.769755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.769904 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.770056 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.770207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.770207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.770207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.770207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.770207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.770207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.770207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.771551 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 16:37:52.771717 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.771862 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.772005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.772005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.772303 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.772465 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.772656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.772814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.772965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.773117 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.773295 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.773459 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.773617 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.773760 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.773910 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.774053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.774205 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.774357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.774501 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.775144 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.775906 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.776057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.776271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.776432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.776577 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.776777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.776951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.777714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.777714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.778014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.778166 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.778310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.778453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.778453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.778741 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.778893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.779044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.779206 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.779357 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.779553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.779707 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.779859 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.780011 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.780207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.780359 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.780516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.780670 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.780822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.781132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.781507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.781671 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.781826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.781972 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.782124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.782268 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.782411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.782565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.782709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.782860 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.783003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.783146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.783289 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.783445 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.783608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.783760 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.783760 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.784042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.784206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.784320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.784410 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.784502 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.784589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.784672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.785195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.785313 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.785443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.785544 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.785630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.785715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.785879 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.785982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.786077 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.786163 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.786243 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.786316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.786400 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.786726 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.786821 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.786895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.786986 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.787079 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.787306 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.787410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.787497 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.787622 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.787622 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.787785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.787878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.787971 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.788056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.788138 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.788138 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.788321 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.792143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.792362 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.792546 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.792741 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.792938 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.793118 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.793275 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.793442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.793602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.793756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.793910 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.794076 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.794237 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.794468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.794468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.794734 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.794888 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.795133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.795568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.795568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.795884 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.796032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.796032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.796618 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.797014 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.797225 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.797448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.797656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.797886 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.798089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.798294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.798514 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.798744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.798954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799170 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799392 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799392 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.799794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.801498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.801498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.801498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.801498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.801498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.801498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.801498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.801498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.803204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.803204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.803204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.803204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.803204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.803204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.803204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.803204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.804864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.804864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.804864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.804864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.804864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.804864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.804864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.804864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.806731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.806731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.806731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.806731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.806731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.806731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.806731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.806731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.808517 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.808726 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.808934 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.808934 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.809355 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.809574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.809574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.812472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.812695 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.813102 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.813327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.813327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.813786 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.813999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.817433 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.817666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.817666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.818110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.818329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.818579 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.818822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.818822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.819234 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.819458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.819458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.819868 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.820100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.820100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.820614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.820833 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.821043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.821263 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.821487 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.821723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.821723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.822621 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.822840 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.822995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.823272 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.823272 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.823698 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.823914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.824362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.824591 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.824591 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.824591 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.825184 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.825393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.825393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.825828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.826072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.826293 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.826515 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.826515 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.826922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.827156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.827428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.829687 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.829687 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.832521 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.832695 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.832837 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.832999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.832999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.833267 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.833417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.833626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.833767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.833767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.834029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.834164 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.834679 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.834936 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.835258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.835458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.835670 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.835919 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.836194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.836465 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.836708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.836939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.837180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.839099 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.839344 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.839601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.839601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.840104 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.841071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.841314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.841634 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.841634 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.842083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.842341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.842341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.842341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.842341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.842341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.842341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.842341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.844593 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.844822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.845076 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.845320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.845576 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.845819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.845819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.846286 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.846535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.846773 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.847122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.847122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.847627 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.847875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.848104 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.848411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.848411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.848753 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.848753 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.849198 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.849198 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.849942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.851989 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.852277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.852545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.852545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.853033 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.853379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.853379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.853832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.854079 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.854319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.854567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.854567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.855032 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.855433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.855433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.855937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.856222 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.856482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.856734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.856972 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.857223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.857223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.857686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.857917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.857917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.858376 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.858614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.858614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.859096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.859357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.859357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.860382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.860502 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.860502 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.860770 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.860861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.860958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861221 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861649 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861749 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861907 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.861986 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862061 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862287 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862366 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862440 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862652 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862811 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.862954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863324 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863641 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.863873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864011 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864494 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864706 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.864917 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865002 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865424 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865505 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865505 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865650 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865812 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865891 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.865969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.866134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.866220 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.866293 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.866383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.866466 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.866539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.866666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.866758 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.866885 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867030 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867030 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867272 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867375 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867637 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867748 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.867941 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.868027 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.868112 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.873836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.873969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.874078 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.874177 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.874281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.874437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.874527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.874621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.874835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.874936 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875024 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875349 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875577 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875577 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875824 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.875824 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876003 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876003 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876177 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876177 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876791 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.876970 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877064 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877064 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877221 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877305 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877397 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877482 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877680 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877773 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877858 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.877957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.878057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.878145 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.878854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.878957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.879052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.879251 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.879342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.879428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.879522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.879609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.879742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.879868 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.879970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880392 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880480 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880633 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880714 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.880936 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.881010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.881082 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.881161 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.881254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.881341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.881434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.881534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.881534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.881867 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.882028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.882028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.882028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.882028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.882028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.883028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.883182 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.883365 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.883522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.883522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.883825 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.883825 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.884115 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.884299 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.884961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.885117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.885273 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.885431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.885585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.885741 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.885848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.885993 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.886094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.886197 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.886293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.886388 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.886476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.886636 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.886792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.886891 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.886977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.887062 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.887147 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.887231 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.887361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.887494 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.887625 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.887764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.887862 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.887960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.888047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.888139 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.888452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.888578 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.888693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.888815 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.888930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.889050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.889163 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.889276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.889387 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.889508 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.889620 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.889620 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.889864 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.889956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.890049 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.890144 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.890248 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.890323 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.890460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.890550 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.890646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.890762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.890941 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891587 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891680 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891765 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891861 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.891953 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.892045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.892132 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.892273 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.892427 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.892524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.892617 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.892703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.892848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.892951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893135 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893404 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893623 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893770 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893892 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.893892 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894054 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894248 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894420 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894505 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894596 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894695 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.894966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895320 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895805 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895946 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895946 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.895946 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.896307 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.896404 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.896491 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.896590 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.896685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.896771 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.896898 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897123 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897389 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897709 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.897940 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898270 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898696 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898781 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.898966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.899406 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.899505 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.899591 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.899733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.899837 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.899926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.900021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.900156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.900786 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.900906 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.900984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.900984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.900984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901225 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.901949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902048 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902134 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902227 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902854 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.902938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903012 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903386 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903472 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.903937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904111 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904257 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904375 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904549 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904647 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.904994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905137 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905315 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905618 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905739 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.905984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:37:52.906291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.906889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.907513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.907513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.907513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.907513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.907513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.907513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.907513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.907513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.908966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.909697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.909697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.909697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.909697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.909697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.909697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.910165 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.910165 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.910328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.910631 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.910958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.911267 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.911573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.911878 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.912256 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.912565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.912890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.913311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.913626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.913932 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.914353 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.914667 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.914980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.915305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.915631 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.915981 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.916310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.916626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.916966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.917296 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.917626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.917968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.918284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.918592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.918919 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.919248 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.919564 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.919891 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.920331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.920659 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.920973 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.921297 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.921624 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.921935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.922246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.922553 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.922860 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.923167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.923494 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.923799 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.924113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.924481 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.924791 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.925098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.925404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.925730 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.926035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.926362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.926676 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.926999 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.927324 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.927630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.928026 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.928281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.928602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.928893 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.929200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.929548 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.929857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.930179 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.930512 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.930846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.931159 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.931516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.931845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.932190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.932555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.932882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.933190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.933494 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.933805 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.934109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.934415 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.934721 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.935028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.935332 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.935635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.935936 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.936282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.936592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.936916 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.937227 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.937534 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.937837 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.938164 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.938483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.938788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.939116 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.939429 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.939752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.940072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.940413 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.940735 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.941051 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.941366 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.941682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.942000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.942309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.942623 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.942944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.943257 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.943818 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.944147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.944483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.944798 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.945112 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.945427 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.945741 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.946053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.946365 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.946676 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.947498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.947835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.948184 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.948512 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.948850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.949172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.949490 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.949853 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.950169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.950527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.950844 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.951152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.951466 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.951786 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.952098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.952437 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.952750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.953065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.953427 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.953691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.954001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.954315 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.954628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.954952 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.955287 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.955608 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.955767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO dbcounter [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Registered counter for database nova_api Aug 23 16:37:52.955923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.956258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.956577 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.957095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.957409 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.957744 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.958070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.958396 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.958714 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.959032 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.959421 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.959732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.960037 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.960371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.960683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.960989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.961312 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.961628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.961932 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.962250 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.962701 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.963853 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.964231 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.964554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.964887 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.965219 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.965542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.965854 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.966183 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.966496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.966806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.967123 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.967437 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.967742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.968051 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.968385 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.968697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.969003 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.969314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.969619 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.969947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.970254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.970560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.970865 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.971213 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.972342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.972657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.972971 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.973302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.973611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.973914 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.974229 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.974538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.975112 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.975421 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.975764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.976049 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.976424 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.976735 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.977088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.977375 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_db.sqlalchemy.engines [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:37:52.977505 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.977783 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.978028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.978383 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.978682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.979035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.979354 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.979919 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.980313 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.980740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.980935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.981264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.981575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.981990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.982187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.982512 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.982828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.983138 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.983450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.983762 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.984073 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.984407 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.984561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writer thread running {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:37:52.984724 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.985038 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.985477 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.985638 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.985950 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.986261 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.986573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.986886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.987200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.987545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.987864 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.988212 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.988535 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.988854 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.989164 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.989475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.989784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.990092 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.990409 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.990761 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.991048 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.991356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.991785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.992098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.992438 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.992761 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.993071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.993394 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.993760 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.994055 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.994373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.994686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.995014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.995352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.995679 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.996005 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.996331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.996636 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.996941 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.997249 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.997566 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.997872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.998175 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.998475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.998782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.999084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.999396 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.999689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:52.999991 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.000318 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.000623 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.000924 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.001231 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.001534 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.001835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.002137 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.002444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.002748 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.003050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.003351 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.003652 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.003953 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.004305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.004643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.004958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.005284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.005595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.006051 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.006231 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.006538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.006861 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.007178 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.007487 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.007819 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.008132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.008467 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.008780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.009091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.009402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.010256 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.010589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.010918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.011223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.011554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.011873 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.012207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.012526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.012839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.013168 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.013477 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.013788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.014098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.014409 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.014719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.015036 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.015347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.015657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.015972 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.016306 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.016634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.016960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.017272 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.017595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.017919 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.018264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.018575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.018917 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.019247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.019561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.019870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.020186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 16:37:53.020434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 16:37:53.042254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.context [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62a6c2c5-851c-4c7c-9543-0f10cb93bbf8(cell1) {{(pid=133198) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 16:37:53.046445 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:37:53.046931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:37:53.048529 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:37:53.049258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:37:53.049710 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:37:53.051692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:37:53.053717 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO dbcounter [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Registered counter for database nova_cell0 Aug 23 16:37:53.057849 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO dbcounter [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Registered counter for database nova_cell1 Aug 23 16:37:53.065222 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_db.sqlalchemy.engines [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:37:53.067212 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_db.sqlalchemy.engines [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:37:53.075415 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writer thread running {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:37:53.075761 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writer thread running {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:37:53.082332 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO dbcounter [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Registered counter for database nova_api Aug 23 16:37:53.103228 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_db.sqlalchemy.engines [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:37:53.109737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writer thread running {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:37:53.167439 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.context [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),62a6c2c5-851c-4c7c-9543-0f10cb93bbf8(cell1) {{(pid=133199) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 16:37:53.171532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:37:53.172018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:37:53.173896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:37:53.174744 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:37:53.175199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:37:53.177224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:37:53.179191 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO dbcounter [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Registered counter for database nova_cell0 Aug 23 16:37:53.183760 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO dbcounter [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Registered counter for database nova_cell1 Aug 23 16:37:53.191232 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_db.sqlalchemy.engines [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:37:53.193554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_db.sqlalchemy.engines [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:37:53.198399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writer thread running {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:37:53.222963 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO dbcounter [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Registered counter for database nova_cell0 Aug 23 16:37:53.229779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_db.sqlalchemy.engines [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:37:53.234300 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writer thread running {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:37:53.346232 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writer thread running {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:37:53.356320 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO dbcounter [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Registered counter for database nova_cell0 Aug 23 16:37:53.365041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_db.sqlalchemy.engines [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 16:37:53.370213 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writer thread running {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 16:37:53.554623 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: WARNING keystonemiddleware.auth_token [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 16:37:53.562920 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: WARNING keystonemiddleware.auth_token [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 16:37:53.700778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: WARNING keystonemiddleware.auth_token [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 16:37:53.708136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: WARNING keystonemiddleware.auth_token [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 16:37:53.911252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: WARNING keystonemiddleware.auth_token [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 16:37:53.918359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: WARNING keystonemiddleware.auth_token [None req-f1777ee4-344a-4623-946a-85908c3b195d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 16:37:53.924337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5632d6b499c0 pid: 133198 (default app) Aug 23 16:37:54.058133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: WARNING keystonemiddleware.auth_token [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 16:37:54.064349 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: WARNING keystonemiddleware.auth_token [None req-db4e8e36-fb71-4215-9556-5cbb19a78c4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 16:37:54.069736 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5632d6b499c0 pid: 133199 (default app) Aug 23 16:38:30.298930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:30.299891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:30.301194 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:30.302116 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:30.881368 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=3 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:30.882242 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=3 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:30.883119 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=3 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:30.883880 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=3 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:38:31.789810 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f5459c3f-415c-4f49-8f40-453ac994adac tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Action: 'create', calling method: .version_select at 0x7f677a1015e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-260662385", "metadata": {"Type": "work"}}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f5459c3f-415c-4f49-8f40-453ac994adac tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Request method failure captured: Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 121 Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKG7OjOvyiMTFl2XxfJqbuTQ5os-79TqUtwn58WpjZGEi9-VEperXUmiiPbkkuVCQl5i9vy9PXTPfq3a98DWwp92K-gEs-MUpP388JOy_SnT1lhAPqnAbCtavDCieRBlyPe7kwviT6GRczFEz-n9sq-4AaUlx_Fm4P1dGCuD3xWt3I Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:38:31.798895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d33059506f5e445e9ac955d874d13dbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 180b8a5599724fec96896f5528b3dae6 Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-260662385", "metadata": {"Type": "work"}}} Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: Aug 23 16:38:31.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-260662385', 'metadata': {'Type': 'work'}}}} Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise error Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi '#$%' Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:31.802508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 16:38:31.803814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 16:38:31.805037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 16:38:31.805037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.805037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f5459c3f-415c-4f49-8f40-453ac994adac tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:31.805037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f5459c3f-415c-4f49-8f40-453ac994adac tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.513543 Aug 23 16:38:31.805037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 23 16:38:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1516 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:38:31.823419 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-54fa62e8-546f-464b-9ec1-7b39e3ca1499 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Action: 'create', calling method: .version_select at 0x7f677a101670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1022629744", "metadata": {"Type": "work"}}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-54fa62e8-546f-464b-9ec1-7b39e3ca1499 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Request method failure captured: Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 120 Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKG7OjOvyiMTFl2XxfJqbuTQ5os-79TqUtwn58WpjZGEi9-VEperXUmiiPbkkuVCQl5i9vy9PXTPfq3a98DWwp92K-gEs-MUpP388JOy_SnT1lhAPqnAbCtavDCieRBlyPe7kwviT6GRczFEz-n9sq-4AaUlx_Fm4P1dGCuD3xWt3I Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:38:31.843996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d33059506f5e445e9ac955d874d13dbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 180b8a5599724fec96896f5528b3dae6 Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1022629744", "metadata": {"Type": "work"}}} Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: Aug 23 16:38:31.846525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1022629744', 'metadata': {'Type': 'work'}}}} Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise error Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi '0' Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:31.847296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 16:38:31.848666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 16:38:31.850125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 16:38:31.850125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.850125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-54fa62e8-546f-464b-9ec1-7b39e3ca1499 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:31.850125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-54fa62e8-546f-464b-9ec1-7b39e3ca1499 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.036845 Aug 23 16:38:31.851264 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 23 16:38:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:38:31.861070 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a28ff73-378d-4eff-90bf-a37ff8997056 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Action: 'create', calling method: .version_select at 0x7f677a03d1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-727865778", "metadata": {"Type": "work"}}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a28ff73-378d-4eff-90bf-a37ff8997056 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Request method failure captured: Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 118 Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKG7OjOvyiMTFl2XxfJqbuTQ5os-79TqUtwn58WpjZGEi9-VEperXUmiiPbkkuVCQl5i9vy9PXTPfq3a98DWwp92K-gEs-MUpP388JOy_SnT1lhAPqnAbCtavDCieRBlyPe7kwviT6GRczFEz-n9sq-4AaUlx_Fm4P1dGCuD3xWt3I Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:38:31.876211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d33059506f5e445e9ac955d874d13dbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 180b8a5599724fec96896f5528b3dae6 Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-727865778", "metadata": {"Type": "work"}}} Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: Aug 23 16:38:31.877742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-727865778', 'metadata': {'Type': 'work'}}}} Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise error Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi '' Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:31.879088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 16:38:31.880821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 16:38:31.883684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 16:38:31.883684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:31.883684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a28ff73-378d-4eff-90bf-a37ff8997056 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:31.883684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1a28ff73-378d-4eff-90bf-a37ff8997056 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022617 Aug 23 16:38:31.886628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 3/3] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 23 16:38:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:38:31.906124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b620c579-3fe2-4d7d-b31e-7021e9c6a7a5 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Calling method '.version_select at 0x7f677a03db80>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:32.484147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9c34bf80-2969-437e-b0f4-ce2e2d1e8b87 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Action: 'create', calling method: .version_select at 0x7f677a1045e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1012123932"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-b620c579-3fe2-4d7d-b31e-7021e9c6a7a5 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] HTTP exception thrown: Volume tempest-invalid-2099394263 could not be found. Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b620c579-3fe2-4d7d-b31e-7021e9c6a7a5 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Request method failure captured: Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2099394263 HTTP/1.1 Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKG7OjOvyiMTFl2XxfJqbuTQ5os-79TqUtwn58WpjZGEi9-VEperXUmiiPbkkuVCQl5i9vy9PXTPfq3a98DWwp92K-gEs-MUpP388JOy_SnT1lhAPqnAbCtavDCieRBlyPe7kwviT6GRczFEz-n9sq-4AaUlx_Fm4P1dGCuD3xWt3I Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:38:33.073999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d33059506f5e445e9ac955d874d13dbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 180b8a5599724fec96896f5528b3dae6 Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Volume tempest-invalid-2099394263 could not be found. Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'tempest-invalid-2099394263'} Aug 23 16:38:33.078715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2099394263 could not be found. (HTTP 404) (Request-ID: req-32312f93-21c5-4bce-8285-d755a68d3fb6) Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:33.079997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 16:38:33.087763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2099394263 could not be found. Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:38:33.090949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2099394263 could not be found. Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2099394263 could not be found. Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b620c579-3fe2-4d7d-b31e-7021e9c6a7a5 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Returning 404 to user: Volume tempest-invalid-2099394263 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b620c579-3fe2-4d7d-b31e-7021e9c6a7a5 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2099394263" status: 404 len: 99 microversion: 2.1 time: 0.904308 Aug 23 16:38:33.093864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Aug 23 16:38:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2099394263 => generated 99 bytes in 906 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 16:38:33.097283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-af4d6e2b-a0e7-4919-8554-5c07273bbc8e tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006955 Aug 23 16:38:33.097283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Aug 23 16:38:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 16:38:33.097283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-12234b4d-1d0d-4008-aa08-5a601824965c tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004141 Aug 23 16:38:33.097283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 6/6] 10.222.0.52 () {58 vars in 1137 bytes} [Tue Aug 23 16:38:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 16:38:33.097283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-99d07918-ba3e-4cac-85fa-4d660e95c278 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Calling method '.version_select at 0x7f6779f714c0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:33.097283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-99d07918-ba3e-4cac-85fa-4d660e95c278 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] HTTP exception thrown: Volume 2d622c29-ac7b-4168-b763-1ef4754e605d could not be found. Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-99d07918-ba3e-4cac-85fa-4d660e95c278 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Request method failure captured: Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: DELETE /compute/v2.1/os-volumes/2d622c29-ac7b-4168-b763-1ef4754e605d HTTP/1.1 Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKG7OjOvyiMTFl2XxfJqbuTQ5os-79TqUtwn58WpjZGEi9-VEperXUmiiPbkkuVCQl5i9vy9PXTPfq3a98DWwp92K-gEs-MUpP388JOy_SnT1lhAPqnAbCtavDCieRBlyPe7kwviT6GRczFEz-n9sq-4AaUlx_Fm4P1dGCuD3xWt3I Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:38:33.098248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d33059506f5e445e9ac955d874d13dbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 180b8a5599724fec96896f5528b3dae6 Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Volume 2d622c29-ac7b-4168-b763-1ef4754e605d could not be found. Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '2d622c29-ac7b-4168-b763-1ef4754e605d'} Aug 23 16:38:33.101562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d622c29-ac7b-4168-b763-1ef4754e605d could not be found. (HTTP 404) (Request-ID: req-5d497a3f-4341-4352-96d2-8cdbd920a203) Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:33.105229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 16:38:33.107574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d622c29-ac7b-4168-b763-1ef4754e605d could not be found. Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 16:38:33.110069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d622c29-ac7b-4168-b763-1ef4754e605d could not be found. Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d622c29-ac7b-4168-b763-1ef4754e605d could not be found. Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-99d07918-ba3e-4cac-85fa-4d660e95c278 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Returning 404 to user: Volume 2d622c29-ac7b-4168-b763-1ef4754e605d could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-99d07918-ba3e-4cac-85fa-4d660e95c278 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/2d622c29-ac7b-4168-b763-1ef4754e605d" status: 404 len: 109 microversion: 2.1 time: 0.171505 Aug 23 16:38:33.111879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 7/7] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:38:32 2022] DELETE /compute/v2.1/os-volumes/2d622c29-ac7b-4168-b763-1ef4754e605d => generated 109 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e04a4490-4ee7-40be-98b5-99de7093c312 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Calling method '.version_select at 0x7f6779f71820>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-e04a4490-4ee7-40be-98b5-99de7093c312 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] HTTP exception thrown: Volume 784c3c19-e041-49c7-920b-c5b25ddbcf98 could not be found. Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e04a4490-4ee7-40be-98b5-99de7093c312 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Request method failure captured: Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/os-volumes/784c3c19-e041-49c7-920b-c5b25ddbcf98 HTTP/1.1 Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKG7OjOvyiMTFl2XxfJqbuTQ5os-79TqUtwn58WpjZGEi9-VEperXUmiiPbkkuVCQl5i9vy9PXTPfq3a98DWwp92K-gEs-MUpP388JOy_SnT1lhAPqnAbCtavDCieRBlyPe7kwviT6GRczFEz-n9sq-4AaUlx_Fm4P1dGCuD3xWt3I Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:38:33.113106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d33059506f5e445e9ac955d874d13dbb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d33059506f5e445e9ac955d874d13dbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: d33059506f5e445e9ac955d874d13dbb Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesNegativeTest-1004283156 Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 180b8a5599724fec96896f5528b3dae6 Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesNegativeTest-1004283156-project Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Volume 784c3c19-e041-49c7-920b-c5b25ddbcf98 could not be found. Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '784c3c19-e041-49c7-920b-c5b25ddbcf98'} Aug 23 16:38:33.114476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 784c3c19-e041-49c7-920b-c5b25ddbcf98 could not be found. (HTTP 404) (Request-ID: req-48ae44fc-a910-4ac0-99ea-7e9995650c38) Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:33.115122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:38:33.118309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 784c3c19-e041-49c7-920b-c5b25ddbcf98 could not be found. Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 16:38:33.119473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 784c3c19-e041-49c7-920b-c5b25ddbcf98 could not be found. Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 784c3c19-e041-49c7-920b-c5b25ddbcf98 could not be found. Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e04a4490-4ee7-40be-98b5-99de7093c312 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] Returning 404 to user: Volume 784c3c19-e041-49c7-920b-c5b25ddbcf98 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e04a4490-4ee7-40be-98b5-99de7093c312 tempest-VolumesNegativeTest-1004283156 tempest-VolumesNegativeTest-1004283156-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/784c3c19-e041-49c7-920b-c5b25ddbcf98" status: 404 len: 109 microversion: 2.1 time: 0.087934 Aug 23 16:38:33.127879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 8/8] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:38:33 2022] GET /compute/v2.1/os-volumes/784c3c19-e041-49c7-920b-c5b25ddbcf98 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:38:34.953279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9c34bf80-2969-437e-b0f4-ce2e2d1e8b87 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.078732 Aug 23 16:38:34.954233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 1/9] 10.222.0.52 () {60 vars in 1155 bytes} [Tue Aug 23 16:38:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4082 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 23 16:38:34.970522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-94efd0f7-6368-4335-a2d4-6b8d9a3c5a23 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f677a03df70>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:35.112212 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-94efd0f7-6368-4335-a2d4-6b8d9a3c5a23 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263" status: 200 len: 345 microversion: 2.1 time: 0.147402 Aug 23 16:38:35.113302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 9/10] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:38:34 2022] GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 => generated 345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:36.126853 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-06defc4a-799f-4204-bc8d-bf669fd2c261 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779fd74c0>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:36.242984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-06defc4a-799f-4204-bc8d-bf669fd2c261 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263" status: 200 len: 345 microversion: 2.1 time: 0.120440 Aug 23 16:38:36.243749 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 2/11] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:38:36 2022] GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:37.256590 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3ddccb7d-1b73-4536-a16b-948e44279892 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779f719d0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:37.399396 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3ddccb7d-1b73-4536-a16b-948e44279892 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263" status: 200 len: 346 microversion: 2.1 time: 0.146360 Aug 23 16:38:37.400838 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 10/12] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:38:37 2022] GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 => generated 346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:37.417311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-203a13fd-2a55-481e-90d5-1e2ba4754145 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Action: 'create', calling method: .version_select at 0x7f6779fd7af0>, body: {"snapshot": {"volume_id": "b4bfd69e-1530-415a-85d6-128a5d2fb263", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-440012369"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:38.173300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-203a13fd-2a55-481e-90d5-1e2ba4754145 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.759841 Aug 23 16:38:38.174002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 3/13] 10.222.0.52 () {60 vars in 1162 bytes} [Tue Aug 23 16:38:37 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:38.191333 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1ca471d3-5ea7-4543-8b98-776305114546 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779f71160>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:38.365146 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1ca471d3-5ea7-4543-8b98-776305114546 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 286 microversion: 2.1 time: 0.182277 Aug 23 16:38:38.372835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 11/14] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:38 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 286 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:38.377912 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-69945ffb-5f32-43f6-85d1-2cedec6b7dd5 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779fefca0>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:38.532465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-69945ffb-5f32-43f6-85d1-2cedec6b7dd5 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.156618 Aug 23 16:38:38.536406 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 4/15] 10.222.0.52 () {58 vars in 1140 bytes} [Tue Aug 23 16:38:38 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:38:38.556735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2d9c1e4a-97c3-4f76-8e3e-85f4e5ac82b2 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779f6d1f0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:38.607632 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2d9c1e4a-97c3-4f76-8e3e-85f4e5ac82b2 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 286 microversion: 2.1 time: 0.064465 Aug 23 16:38:38.608213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 12/16] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:38 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:39.632896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f40ff08f-101d-4692-96b9-34381d4b275b tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779fd7b80>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:39.719621 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f40ff08f-101d-4692-96b9-34381d4b275b tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 286 microversion: 2.1 time: 0.103064 Aug 23 16:38:39.720960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 5/17] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:39 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:40.733306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-17ca6d13-852c-465b-b68f-b32d43266588 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779f71430>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:40.794011 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-17ca6d13-852c-465b-b68f-b32d43266588 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 286 microversion: 2.1 time: 0.064461 Aug 23 16:38:40.794690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 13/18] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:40 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:41.811783 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-000b1e06-f5d4-41f1-8c7a-32751b2d6b96 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779fd7820>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:41.878473 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-000b1e06-f5d4-41f1-8c7a-32751b2d6b96 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 286 microversion: 2.1 time: 0.074723 Aug 23 16:38:41.879548 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 6/19] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:41 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:42.832466 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9239bfa7-9714-4162-8f8f-3445f217f61a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: .version_select at 0x7f6779f41a60>, body: {"keypair": {"name": "tempest-keypair-1614556171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXd2ntxonPAKLXGNGVqAlkyHSnuDYh7f6CPONM7/Votw9N3T8zKHdcmf93fs5pbuIHE/btyZCO6H+2DTIjkNb9LouIJy40pR+VJxLfpKS78xNQ4OVW4zLWK8shKP7AEwQ=="}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:42.891381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a23b9aea-8b0e-4971-a5d4-563269d5ea80 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f677a104700>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:42.977862 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a23b9aea-8b0e-4971-a5d4-563269d5ea80 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 286 microversion: 2.1 time: 0.090376 Aug 23 16:38:42.978751 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 7/20] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:42 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:38:42.984935 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-9239bfa7-9714-4162-8f8f-3445f217f61a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:38:43.005419 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-9239bfa7-9714-4162-8f8f-3445f217f61a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for user a642d26e91c8449296a7a6733221824f and project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:38:43.194136 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9239bfa7-9714-4162-8f8f-3445f217f61a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.912020 Aug 23 16:38:43.196094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 14/21] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:38:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:43.991018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8080eb30-a40a-4a24-87b4-2288ab0b0637 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779fd7820>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:44.074816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8080eb30-a40a-4a24-87b4-2288ab0b0637 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 286 microversion: 2.1 time: 0.087860 Aug 23 16:38:44.076040 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 8/22] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:43 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:45.100289 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-498fb887-8bea-485d-a1ce-eafba967e1ab tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779ec89d0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:45.244223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-498fb887-8bea-485d-a1ce-eafba967e1ab tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 286 microversion: 2.1 time: 0.154003 Aug 23 16:38:45.249975 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 15/23] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:45 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:46.265576 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ae062390-477e-4522-8e0f-c770a981f692 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779fd7b80>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:46.350218 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ae062390-477e-4522-8e0f-c770a981f692 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 287 microversion: 2.1 time: 0.096450 Aug 23 16:38:46.365952 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 9/24] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:46 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:46.377801 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4dd5275e-bec7-4b4d-be4b-b15fceb43529 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779ef2790>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:46.656842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4dd5275e-bec7-4b4d-be4b-b15fceb43529 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 202 len: 0 microversion: 2.1 time: 0.296340 Aug 23 16:38:46.658904 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 16/25] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Aug 23 16:38:46 2022] DELETE /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:38:46.678061 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bfd72558-8d47-47d3-a10e-dd0547d18d44 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779ef2e50>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:46.740089 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bfd72558-8d47-47d3-a10e-dd0547d18d44 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 200 len: 286 microversion: 2.1 time: 0.070439 Aug 23 16:38:46.740747 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 17/26] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:46 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:46.766426 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2123821625", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "networks": [{"uuid": "ab5990dc-e1a7-4c98-9abe-052175ae94a8"}]}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:47.007183 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] validate_networks() for [('ab5990dc-e1a7-4c98-9abe-052175ae94a8', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:38:47.754105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fce30e58-1736-4430-bf64-1538c4e75a13 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779ef2c10>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:47.805984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-fce30e58-1736-4430-bf64-1538c4e75a13 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] HTTP exception thrown: Snapshot 58bf9384-f361-41f1-aa0a-28f67a723843 could not be found. Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fce30e58-1736-4430-bf64-1538c4e75a13 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Request method failure captured: Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 HTTP/1.1 Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKGS5qgpKPl0cRk8vFTAuVjg1UI1xOodiPkqSFgCnK60wg5KY5QrczUirPtrsQ80c0EUvcPd_eCBQV27mShwIitZkqYkVvVHqtVZdFdEbY-PKY4yOeCv2QUneYkbroGyA-TzN7QgdHD5Zec4Huj1Xo-2hrA9CfcLyX6L1TdLC0olss Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 01c4e1c0d220404e8ef64e2304526bf4 Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:38:47.813694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01c4e1c0d220404e8ef64e2304526bf4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 01c4e1c0d220404e8ef64e2304526bf4 Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesSnapshotsTestJSON-2136242129-project Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: daa04c30adf84bdba03de4729004e2e8 Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136242129-project Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Snapshot 58bf9384-f361-41f1-aa0a-28f67a723843 could not be found. Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '58bf9384-f361-41f1-aa0a-28f67a723843'} Aug 23 16:38:47.814779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 58bf9384-f361-41f1-aa0a-28f67a723843 could not be found. (HTTP 404) (Request-ID: req-8a135d92-8575-417c-a5e6-77a60ee649cc) Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:47.815469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:38:47.816405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 58bf9384-f361-41f1-aa0a-28f67a723843 could not be found. Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 23 16:38:47.818800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 58bf9384-f361-41f1-aa0a-28f67a723843 could not be found. Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 58bf9384-f361-41f1-aa0a-28f67a723843 could not be found. Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fce30e58-1736-4430-bf64-1538c4e75a13 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Returning 404 to user: Snapshot 58bf9384-f361-41f1-aa0a-28f67a723843 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:47.822288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fce30e58-1736-4430-bf64-1538c4e75a13 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843" status: 404 len: 111 microversion: 2.1 time: 0.066172 Aug 23 16:38:47.823968 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 18/27] 10.222.0.52 () {58 vars in 1251 bytes} [Tue Aug 23 16:38:47 2022] GET /compute/v2.1/os-snapshots/58bf9384-f361-41f1-aa0a-28f67a723843 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:38:47.824975 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ce10189b-88d6-40c9-8b02-5ba31a6fb429 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779ec8a60>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:48.123067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ce10189b-88d6-40c9-8b02-5ba31a6fb429 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263" status: 202 len: 0 microversion: 2.1 time: 0.301924 Aug 23 16:38:48.123713 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 19/28] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:38:47 2022] DELETE /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 16:38:48.134583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b7b6af47-f05b-4d96-a6f9-bf8b01061e49 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779f71c10>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:48.300603 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b7b6af47-f05b-4d96-a6f9-bf8b01061e49 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263" status: 200 len: 345 microversion: 2.1 time: 0.171301 Aug 23 16:38:48.307773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 20/29] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:38:48 2022] GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:38:49.355748 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:38:49.356857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:38:49.358414 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:38:49.359245 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:38:49.359847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:38:49.411132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:49.411622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:49.412054 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:49.419340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:49.420191 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:49.423939 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:49.466282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-975079934", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:49.515914 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Getting quotas for project 0c44875761174fa092919342baf9022d. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:38:49.524932 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Getting quotas for user d387030ec72f4807869e721db76e490e and project 0c44875761174fa092919342baf9022d. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:38:49.546949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:38:49.551588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:38:49.655912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] validate_networks() for [('958e307a-9cd7-4eba-9cf6-b241bcc41dcd', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:38:49.845009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-17e58cbe-6fa6-46b0-afad-905fdad45697 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.453549 Aug 23 16:38:49.846027 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 10/30] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:38:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:38:49.858780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7867a9ec-5110-4ff8-8326-92812ed4ee7c tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779ef3c10>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:49.921153 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-7867a9ec-5110-4ff8-8326-92812ed4ee7c tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] HTTP exception thrown: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7867a9ec-5110-4ff8-8326-92812ed4ee7c tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Request method failure captured: Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 HTTP/1.1 Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKGS5qgpKPl0cRk8vFTAuVjg1UI1xOodiPkqSFgCnK60wg5KY5QrczUirPtrsQ80c0EUvcPd_eCBQV27mShwIitZkqYkVvVHqtVZdFdEbY-PKY4yOeCv2QUneYkbroGyA-TzN7QgdHD5Zec4Huj1Xo-2hrA9CfcLyX6L1TdLC0olss Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 01c4e1c0d220404e8ef64e2304526bf4 Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:38:49.927181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01c4e1c0d220404e8ef64e2304526bf4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 01c4e1c0d220404e8ef64e2304526bf4 Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-VolumesSnapshotsTestJSON-2136242129-project Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: daa04c30adf84bdba03de4729004e2e8 Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136242129-project Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': 'b4bfd69e-1530-415a-85d6-128a5d2fb263'} Aug 23 16:38:49.928597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. (HTTP 404) (Request-ID: req-a038d6b1-b891-48c4-b416-08dc02264bae) Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:49.929336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:38:49.930375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 16:38:49.931488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7867a9ec-5110-4ff8-8326-92812ed4ee7c tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Returning 404 to user: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:49.932700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7867a9ec-5110-4ff8-8326-92812ed4ee7c tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263" status: 404 len: 109 microversion: 2.1 time: 0.084928 Aug 23 16:38:49.940034 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 11/31] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:38:49 2022] GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:38:50.110744 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cd718f59-304a-4891-894b-cb43b1cd7b18 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'create', calling method: .version_select at 0x7f6778e8cee0>, body: {"keypair": {"name": "tempest-keypair-1506735711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAs7G9Ihy/6KwHpNoguYyWRoAEAN/PGKA3VGqCyX4fBezBO6c5w1TWAF/PU2FgapLOmmGichVHDF4f8ksoelRgIcdCY6zlzkPZk9qFreSEnS/SCjmP7kRTk/IUfsF5gknA=="}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:50.169305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-cd718f59-304a-4891-894b-cb43b1cd7b18 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Getting quotas for project 97dc90210f5845e98a6bdb51aaef3518. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:38:50.180302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-cd718f59-304a-4891-894b-cb43b1cd7b18 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Getting quotas for user 5cbfcfbe01834b9ab9179bc032db813e and project 97dc90210f5845e98a6bdb51aaef3518. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:38:50.295531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cd718f59-304a-4891-894b-cb43b1cd7b18 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.351112 Aug 23 16:38:50.295531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 12/32] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:38:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:38:50.300094 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-27838c0c-f005-4ab1-a65d-5b452dd79890 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:50.301224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-27838c0c-f005-4ab1-a65d-5b452dd79890 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:50.479995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-27838c0c-f005-4ab1-a65d-5b452dd79890 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:50.526922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-27838c0c-f005-4ab1-a65d-5b452dd79890 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1215 microversion: 2.1 time: 0.231609 Aug 23 16:38:50.528738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 13/33] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:50 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1215 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:50.537460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5de883ae-ed10-4abf-b315-7b82317f5c81 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6778e6c790>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:50.632927 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-5de883ae-ed10-4abf-b315-7b82317f5c81 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] HTTP exception thrown: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5de883ae-ed10-4abf-b315-7b82317f5c81 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Request method failure captured: Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: DELETE /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 HTTP/1.1 Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKGS5qgpKPl0cRk8vFTAuVjg1UI1xOodiPkqSFgCnK60wg5KY5QrczUirPtrsQ80c0EUvcPd_eCBQV27mShwIitZkqYkVvVHqtVZdFdEbY-PKY4yOeCv2QUneYkbroGyA-TzN7QgdHD5Zec4Huj1Xo-2hrA9CfcLyX6L1TdLC0olss Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 01c4e1c0d220404e8ef64e2304526bf4 Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:38:50.636110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01c4e1c0d220404e8ef64e2304526bf4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 01c4e1c0d220404e8ef64e2304526bf4 Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-VolumesSnapshotsTestJSON-2136242129-project Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: daa04c30adf84bdba03de4729004e2e8 Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136242129-project Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': 'b4bfd69e-1530-415a-85d6-128a5d2fb263'} Aug 23 16:38:50.637247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. (HTTP 404) (Request-ID: req-30c0d8f0-754a-47ea-aad9-70e707763ce2) Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:50.637955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 16:38:50.638920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 16:38:50.639842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:50.643290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:38:50.649319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5de883ae-ed10-4abf-b315-7b82317f5c81 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Returning 404 to user: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:50.651510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5de883ae-ed10-4abf-b315-7b82317f5c81 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263" status: 404 len: 109 microversion: 2.1 time: 0.119466 Aug 23 16:38:50.652798 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 14/34] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:38:50 2022] DELETE /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:38:50.668922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1331978999", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8232e7cf-7851-4756-8389-6e87e5a21279"}], "security_groups": [{"name": "tempest-securitygroup--1969732861"}], "key_name": "tempest-keypair-1614556171", "user_data": "}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:50.961026 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] validate_networks() for [('8232e7cf-7851-4756-8389-6e87e5a21279', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:38:51.904394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:38:51.904930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:38:51.905294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:38:51.906046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:38:51.906681 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:38:51.938756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:51.939093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:51.939678 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:51.941370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:51.941848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:51.945704 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:52.026046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Getting quotas for project 102f835e0f424477aab1d540a2a15d22. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:38:52.037656 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Getting quotas for user 50c9a90fabc0466988ed6bae32beb47f and project 102f835e0f424477aab1d540a2a15d22. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:38:52.072010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:38:52.076105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:38:52.297594 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-97b204ee-bdd9-4bd3-a8f0-10041684afa3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.126581 Aug 23 16:38:52.306686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 21/35] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:38:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 16:38:52.318248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8e8efccf-4290-455a-8fd2-51ed9ca22280 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Calling method '.version_select at 0x7f6779613dc0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:52.346472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:38:52.346967 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:38:52.347730 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:38:52.348270 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:38:52.348987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:38:52.367434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:52.367923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:52.371246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:52.374077 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:52.377643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:52.378305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:52.409017 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-8e8efccf-4290-455a-8fd2-51ed9ca22280 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] HTTP exception thrown: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8e8efccf-4290-455a-8fd2-51ed9ca22280 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Request method failure captured: Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 HTTP/1.1 Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKGS5qgpKPl0cRk8vFTAuVjg1UI1xOodiPkqSFgCnK60wg5KY5QrczUirPtrsQ80c0EUvcPd_eCBQV27mShwIitZkqYkVvVHqtVZdFdEbY-PKY4yOeCv2QUneYkbroGyA-TzN7QgdHD5Zec4Huj1Xo-2hrA9CfcLyX6L1TdLC0olss Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 01c4e1c0d220404e8ef64e2304526bf4 Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:38:52.411709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_01c4e1c0d220404e8ef64e2304526bf4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/01c4e1c0d220404e8ef64e2304526bf4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 01c4e1c0d220404e8ef64e2304526bf4 Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2136242129 Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesSnapshotsTestJSON-2136242129-project Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: daa04c30adf84bdba03de4729004e2e8 Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2136242129-project Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'b4bfd69e-1530-415a-85d6-128a5d2fb263'} Aug 23 16:38:52.413244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. (HTTP 404) (Request-ID: req-16bffcf3-27e6-4028-8305-91158724fb1b) Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:52.413885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:38:52.414791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 16:38:52.415722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. Aug 23 16:38:52.416970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:38:52.418609 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8e8efccf-4290-455a-8fd2-51ed9ca22280 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] Returning 404 to user: Volume b4bfd69e-1530-415a-85d6-128a5d2fb263 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:38:52.418793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:38:52.419999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8e8efccf-4290-455a-8fd2-51ed9ca22280 tempest-VolumesSnapshotsTestJSON-2136242129 tempest-VolumesSnapshotsTestJSON-2136242129-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263" status: 404 len: 109 microversion: 2.1 time: 0.110672 Aug 23 16:38:52.420949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 22/36] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:38:52 2022] GET /compute/v2.1/os-volumes/b4bfd69e-1530-415a-85d6-128a5d2fb263 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:38:52.434857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for user a642d26e91c8449296a7a6733221824f and project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:38:52.441578 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9f27110f-f4bf-4428-8d88-d89afbef6caa tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:52.442237 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9f27110f-f4bf-4428-8d88-d89afbef6caa tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:52.455390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:38:52.458987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:38:52.706625 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9f27110f-f4bf-4428-8d88-d89afbef6caa tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:52.748709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9f27110f-f4bf-4428-8d88-d89afbef6caa tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1215 microversion: 2.1 time: 0.326429 Aug 23 16:38:52.765062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 23/37] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:52 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1215 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:52.765966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c875b171-b259-4c3f-83bf-a1e7307db026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:52.766747 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c875b171-b259-4c3f-83bf-a1e7307db026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:52.767729 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f838e587-6b32-4009-9bff-90e0eeb7b1b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.113555 Aug 23 16:38:52.770603 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 15/38] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:38:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:38:52.793458 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-399ab246-dcd9-4e9f-a6f8-5dcd8ca2075e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:52.804311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-399ab246-dcd9-4e9f-a6f8-5dcd8ca2075e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:52.901517 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c875b171-b259-4c3f-83bf-a1e7307db026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:52.912723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c875b171-b259-4c3f-83bf-a1e7307db026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1221 microversion: 2.1 time: 0.154471 Aug 23 16:38:52.914791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 24/39] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:52 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1221 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:53.076985 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-399ab246-dcd9-4e9f-a6f8-5dcd8ca2075e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:53.094282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-399ab246-dcd9-4e9f-a6f8-5dcd8ca2075e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1242 microversion: 2.1 time: 0.312093 Aug 23 16:38:53.097643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 16/40] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:52 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1242 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:53.383988 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-208981677", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:53.495320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] validate_networks() for [('958e307a-9cd7-4eba-9cf6-b241bcc41dcd', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:38:53.772535 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:53.773740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:53.790130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:53.794379 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:53.794987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:53.796921 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:53.797777 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:53.799332 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:54.096316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:54.126274 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b31dccc4-d16c-4562-ab81-e4e2434a02d8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1219 microversion: 2.1 time: 0.355899 Aug 23 16:38:54.129393 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 17/41] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:53 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1219 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:38:54.138028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c6b4c710-43a4-45fd-abf0-4a31da00923e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:54.138891 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c6b4c710-43a4-45fd-abf0-4a31da00923e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:54.403315 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c6b4c710-43a4-45fd-abf0-4a31da00923e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:54.411773 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c6b4c710-43a4-45fd-abf0-4a31da00923e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1242 microversion: 2.1 time: 0.281037 Aug 23 16:38:54.418566 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 18/42] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:54 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1242 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:54.896376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:38:54.896376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:38:54.896376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:38:54.896376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:38:54.896376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:38:54.909683 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:54.910218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:54.910663 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:54.911592 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:54.912103 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:54.913373 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:54.991983 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Getting quotas for project 102f835e0f424477aab1d540a2a15d22. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:38:55.000958 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Getting quotas for user 50c9a90fabc0466988ed6bae32beb47f and project 102f835e0f424477aab1d540a2a15d22. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:38:55.061728 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:38:55.070278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:38:55.147277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:55.147898 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:55.157918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:55.158446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:55.166699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:55.168149 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:55.168831 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:55.169597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:55.254311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:55.262318 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-33f5c816-f02f-4bda-9d5c-32427696291f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1211 microversion: 2.1 time: 0.118818 Aug 23 16:38:55.275872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 19/43] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:55 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1211 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:38:55.416914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-20c2ff53-d0ac-4db7-8c6a-9a63e1cea446 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.037132 Aug 23 16:38:55.419450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 25/44] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:38:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:38:55.432249 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-52b3185b-b47a-487b-b2ed-bf6d7453b19f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:55.432965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-52b3185b-b47a-487b-b2ed-bf6d7453b19f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:55.442102 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:55.443034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:55.493888 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:55.499708 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:55.502611 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:55.513347 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:55.514926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:55.516742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:55.581099 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-52b3185b-b47a-487b-b2ed-bf6d7453b19f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:55.619229 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-52b3185b-b47a-487b-b2ed-bf6d7453b19f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1221 microversion: 2.1 time: 0.191628 Aug 23 16:38:55.684977 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 20/45] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:55 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1221 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:55.968841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:56.018404 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f2d4a5a8-4b13-442d-b0d7-4ead36709d03 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1238 microversion: 2.1 time: 0.571433 Aug 23 16:38:56.022634 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 26/46] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:55 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1238 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:56.287148 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:56.288658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:56.312646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:56.313158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:56.313605 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:56.314340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:56.321133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:56.322949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:56.640520 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:56.656604 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c52380d6-3d61-4638-aed3-2b5d9a92240a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1275 microversion: 2.1 time: 0.373790 Aug 23 16:38:56.657223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 21/47] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:56 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1275 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:56.722754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d75a2bd0-c9ed-42a2-b728-3c2a45541886 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:56.723421 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d75a2bd0-c9ed-42a2-b728-3c2a45541886 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:57.041376 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:57.042011 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:57.055501 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:57.056005 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:57.067601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:57.073549 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:57.074214 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:57.074820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:57.257265 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:57.281397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d75a2bd0-c9ed-42a2-b728-3c2a45541886 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:57.294103 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d75a2bd0-c9ed-42a2-b728-3c2a45541886 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1221 microversion: 2.1 time: 0.573806 Aug 23 16:38:57.300913 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 27/48] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:56 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1221 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:57.302657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-571328fe-71b4-4582-8d6f-c5b9ecec0069 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1294 microversion: 2.1 time: 0.263512 Aug 23 16:38:57.303897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 22/49] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:57 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1294 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:38:57.679047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:38:57.679960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:38:57.697441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:57.697993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:57.698444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:57.699317 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:38:57.699911 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:38:57.700672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:38:57.755109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1860685030", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bf26c0b-4203-4d7e-869d-a3c87b647f65"}], "security_groups": [{"name": "tempest-securitygroup--1279213601"}], "key_name": "tempest-keypair-1506735711", "user_data": "}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:38:57.938032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:38:57.948045 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2bc29b31-338b-4bec-884e-e0caf485061c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1273 microversion: 2.1 time: 0.273631 Aug 23 16:38:57.950273 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 28/50] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:38:57 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:38:58.337527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] validate_networks() for [('6bf26c0b-4203-4d7e-869d-a3c87b647f65', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:38:58.904385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5e2583db-68bc-4628-9912-12b0cbec4581 tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] Action: 'create', calling method: .version_select at 0x7f67785e1550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-652269943", "metadata": {"Type": "work"}}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:00.795887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5e2583db-68bc-4628-9912-12b0cbec4581 tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.551362 Aug 23 16:39:00.797258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 29/51] 10.222.0.52 () {60 vars in 1156 bytes} [Tue Aug 23 16:38:58 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2553 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 23 16:39:00.804302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:00.806859 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:00.824059 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:00.825655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:00.832027 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:00.836369 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:00.838345 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:00.839984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:01.246856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:01.246856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e78ad778-6067-4f9e-a476-311c4bdad13d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1279 microversion: 2.1 time: 0.239921 Aug 23 16:39:01.246856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 30/52] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:00 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:01.246856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:01.248324 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:39:01.249543 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:01.249988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:39:01.249988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:39:01.249988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:39:01.249988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:39:01.250519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:01.250519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:01.250519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:01.250519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:01.251072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:01.251072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:01.251395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:01.251395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:01.251395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:01.251395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:01.251657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:01.251657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:01.251657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Getting quotas for project 97dc90210f5845e98a6bdb51aaef3518. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:39:01.251657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Getting quotas for user 5cbfcfbe01834b9ab9179bc032db813e and project 97dc90210f5845e98a6bdb51aaef3518. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:39:01.251902 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:39:01.251902 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:39:01.309873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:01.322921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ed1712f8-d941-4d2f-b181-77465845afd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1300 microversion: 2.1 time: 0.282642 Aug 23 16:39:01.323508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 31/53] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:01 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1300 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:01.337486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:01.344207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:01.363760 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:01.372932 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:01.373609 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:01.374468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:01.375015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:01.375522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:01.734419 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-347b14b1-05ef-473b-b3bf-7f802f913113 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.983477 Aug 23 16:39:01.741514 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 23/54] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:38:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 3991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:39:01.759496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-48738577-3a05-4cbc-acd7-2edcabbf59ac tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] Calling method '.version_select at 0x7f67785b9d30>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:02.133570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:02.163441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-537972e6-3210-441b-88e3-fbb71b6385ba tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.838729 Aug 23 16:39:02.164129 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 32/55] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:01 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:02.190720 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-daaf6a53-675b-46bb-a16e-07221f47b685 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:02.191560 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-daaf6a53-675b-46bb-a16e-07221f47b685 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:02.328200 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-daaf6a53-675b-46bb-a16e-07221f47b685 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:02.346526 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-daaf6a53-675b-46bb-a16e-07221f47b685 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1238 microversion: 2.1 time: 0.172227 Aug 23 16:39:02.346526 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 33/56] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:02 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1238 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:02.355998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:02.358914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:02.386218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:02.387520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:02.388045 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:02.390520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:02.391175 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:02.394716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:02.472554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-48738577-3a05-4cbc-acd7-2edcabbf59ac tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/627463e8-b812-4c98-801a-5260c509a023" status: 200 len: 353 microversion: 2.1 time: 0.729220 Aug 23 16:39:02.483012 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 24/57] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:39:01 2022] GET /compute/v2.1/os-volumes/627463e8-b812-4c98-801a-5260c509a023 => generated 353 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:02.489205 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:02.490143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:02.510207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:02.510993 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:02.511605 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:02.513593 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:02.514845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:02.516496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:02.742567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:02.751376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2d0615c0-7c37-4efd-b74c-f8051f7e233a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1279 microversion: 2.1 time: 0.407379 Aug 23 16:39:02.753747 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 34/58] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:02 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1279 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:02.905658 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-e29cf80e-30a6-4a05-83c9-1d607db40063 req-6b4797f9-04bf-4cb4-b3be-8dd3e80906af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9c4b544-8888-42a5-9d5e-2add07e40c69", "tag": "957d3383-6848-4d1d-8aca-dbef211d2c23"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:02.946613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e29cf80e-30a6-4a05-83c9-1d607db40063 req-6b4797f9-04bf-4cb4-b3be-8dd3e80906af service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:02.947150 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e29cf80e-30a6-4a05-83c9-1d607db40063 req-6b4797f9-04bf-4cb4-b3be-8dd3e80906af service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:02.947584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e29cf80e-30a6-4a05-83c9-1d607db40063 req-6b4797f9-04bf-4cb4-b3be-8dd3e80906af service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:03.025912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-e29cf80e-30a6-4a05-83c9-1d607db40063 req-6b4797f9-04bf-4cb4-b3be-8dd3e80906af service nova] Creating event network-changed:957d3383-6848-4d1d-8aca-dbef211d2c23 for instance a9c4b544-8888-42a5-9d5e-2add07e40c69 on hv-cinder-85032 Aug 23 16:39:03.033840 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e29cf80e-30a6-4a05-83c9-1d607db40063 req-6b4797f9-04bf-4cb4-b3be-8dd3e80906af service nova] Acquiring lock "compute-rpcapi-router" {{(pid=133198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 16:39:03.034252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e29cf80e-30a6-4a05-83c9-1d607db40063 req-6b4797f9-04bf-4cb4-b3be-8dd3e80906af service nova] Acquired lock "compute-rpcapi-router" {{(pid=133198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 16:39:03.035401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0e1eda59-532b-496c-9aab-17808b7b4218 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:03.035873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0e1eda59-532b-496c-9aab-17808b7b4218 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:03.038364 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:03.051682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0e1eda59-532b-496c-9aab-17808b7b4218 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:03.052564 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0e1eda59-532b-496c-9aab-17808b7b4218 None None] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:03.053083 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0e1eda59-532b-496c-9aab-17808b7b4218 None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:03.053528 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0e1eda59-532b-496c-9aab-17808b7b4218 None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:03.060514 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7ed97509-00b0-4cc2-94c1-ef9851b6d1b5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.576134 Aug 23 16:39:03.083200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 25/59] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:02 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:03.092484 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-24c58607-7463-464f-834a-fcc0e4a24f90 tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] Calling method '.version_select at 0x7f677856f820>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:03.130736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.compute.rpcapi [None req-0e1eda59-532b-496c-9aab-17808b7b4218 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 16:39:03.159254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0e1eda59-532b-496c-9aab-17808b7b4218 None None] Releasing lock "compute-rpcapi-router" {{(pid=133198) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 16:39:03.231967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0e1eda59-532b-496c-9aab-17808b7b4218 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.451763 Aug 23 16:39:03.232970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 35/60] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:03.241266 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:03.247253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:03.265364 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:03.283623 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:03.284559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:03.285615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:03.286247 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:03.286799 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:03.294898 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-24c58607-7463-464f-834a-fcc0e4a24f90 tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/627463e8-b812-4c98-801a-5260c509a023" status: 200 len: 353 microversion: 2.1 time: 0.220972 Aug 23 16:39:03.313257 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 26/61] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:39:03 2022] GET /compute/v2.1/os-volumes/627463e8-b812-4c98-801a-5260c509a023 => generated 353 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:03.318170 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e373de1d-4848-47a1-928d-7780ebb62310 tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] Calling method '.version_select at 0x7f6778542550>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:03.670239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e373de1d-4848-47a1-928d-7780ebb62310 tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/627463e8-b812-4c98-801a-5260c509a023" status: 202 len: 0 microversion: 2.1 time: 0.355736 Aug 23 16:39:03.674875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 27/62] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:39:03 2022] DELETE /compute/v2.1/os-volumes/627463e8-b812-4c98-801a-5260c509a023 => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:39:03.683399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:03.684145 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:03.712001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:03.713488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:03.716074 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:03.718085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:03.721380 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:03.722157 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:03.950716 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:03.971787 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ce89f02a-9474-4670-bf7c-16f813d82ce9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1242 microversion: 2.1 time: 0.288739 Aug 23 16:39:03.977486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 28/63] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:03 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1242 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:03.990291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-17e3e141-b2eb-4bd3-8a5c-b3594c43af7f tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] Calling method '.version_select at 0x7f67785b9b80>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:04.063008 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:04.074551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6b5986b3-650e-4e25-b804-4ea75cea2389 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.837755 Aug 23 16:39:04.091845 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 36/64] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:03 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:04.108368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:04.109348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:04.123567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:04.132636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:04.133499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:04.138554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:04.139359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:04.140015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:04.333788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-17e3e141-b2eb-4bd3-8a5c-b3594c43af7f tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] HTTP exception thrown: Volume 627463e8-b812-4c98-801a-5260c509a023 could not be found. Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-17e3e141-b2eb-4bd3-8a5c-b3594c43af7f tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] Request method failure captured: Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/os-volumes/627463e8-b812-4c98-801a-5260c509a023 HTTP/1.1 Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKibzD7rFv1_lZPD5SRHJ63OZ1DEFpBD85grC7cLBROihDYxCW8S0YD5nQAMv4mr15SmMsUKUjwLEGNiCe7hBRqA05rhI0iJ6-Ykb4ShAzoaHB2_HBoxvzN9FWd0bSfiObIANkn3DvHZxcma9YlfD8aK6PEIMEnDtItMkM38LSzpqI Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 7fcc167c6c91464e922cc1819ff36acd Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-VolumesGetTestJSON-1887211647 Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:39:04.336518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7fcc167c6c91464e922cc1819ff36acd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7fcc167c6c91464e922cc1819ff36acd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7fcc167c6c91464e922cc1819ff36acd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7fcc167c6c91464e922cc1819ff36acd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-VolumesGetTestJSON-1887211647 Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 7fcc167c6c91464e922cc1819ff36acd Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-VolumesGetTestJSON-1887211647 Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-VolumesGetTestJSON-1887211647-project Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 81e4e06aecad466cb8f1ad0e60fdfb7c Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-VolumesGetTestJSON-1887211647-project Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Volume 627463e8-b812-4c98-801a-5260c509a023 could not be found. Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '627463e8-b812-4c98-801a-5260c509a023'} Aug 23 16:39:04.338022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 627463e8-b812-4c98-801a-5260c509a023 could not be found. (HTTP 404) (Request-ID: req-2fe4a598-f0d6-4bf5-ba09-1f8a46dbe70a) Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:39:04.338949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 16:39:04.340216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 627463e8-b812-4c98-801a-5260c509a023 could not be found. Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 16:39:04.344472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 627463e8-b812-4c98-801a-5260c509a023 could not be found. Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 627463e8-b812-4c98-801a-5260c509a023 could not be found. Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-17e3e141-b2eb-4bd3-8a5c-b3594c43af7f tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] Returning 404 to user: Volume 627463e8-b812-4c98-801a-5260c509a023 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:39:04.346065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-17e3e141-b2eb-4bd3-8a5c-b3594c43af7f tempest-VolumesGetTestJSON-1887211647 tempest-VolumesGetTestJSON-1887211647-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/627463e8-b812-4c98-801a-5260c509a023" status: 404 len: 109 microversion: 2.1 time: 0.368748 Aug 23 16:39:04.347500 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 29/65] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:39:03 2022] GET /compute/v2.1/os-volumes/627463e8-b812-4c98-801a-5260c509a023 => generated 109 bytes in 374 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:39:04.366333 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:04.372106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:04.383222 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:04.384225 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:04.386769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:04.387741 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:04.388432 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:04.389697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:04.701694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:04.719577 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-116d69a9-b523-42ab-8bea-e7b0d7e7ab56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1279 microversion: 2.1 time: 0.625860 Aug 23 16:39:04.721050 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 37/66] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:04 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1279 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:04.993390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:05.000227 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:05.000898 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:05.004570 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0081df66-08d7-4e84-a67e-8f882ff3f08d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.654750 Aug 23 16:39:05.005325 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 30/67] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:04 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:05.008078 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:05.008982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:05.009417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:05.010127 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:05.010572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:05.011033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:05.106229 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:05.106959 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:05.118492 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:05.119649 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:05.123714 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:05.126288 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:05.128592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:05.129062 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:05.545214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:05.558949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-db10ad7d-ca68-413d-8a43-0cf34ce5f4a2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1290 microversion: 2.1 time: 0.564372 Aug 23 16:39:05.561346 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 38/68] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:04 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1290 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:05.747960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:05.749451 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:05.769796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:05.773813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:05.774429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:05.775995 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:05.776755 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:05.778230 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:05.809563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:05.822918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-03a5c1b3-0335-4f9c-a632-3dae0c882d0d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.726572 Aug 23 16:39:05.825489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 31/69] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:05 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:06.038294 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:06.039667 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:06.046282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:06.047303 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:06.048665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:06.049582 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:06.050193 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:06.050774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:06.135211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:06.143100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e486b1ff-3445-4f37-acd9-2e7c27e5f90a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.399877 Aug 23 16:39:06.144046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 39/70] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:05 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:06.453622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:06.462202 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-97435841-57d2-40d0-a671-fee53f91f29d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.433648 Aug 23 16:39:06.462909 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 32/71] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:06 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:06.608534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:06.612721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:06.647144 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:06.651754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:06.653027 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:06.656077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:06.661084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:06.662163 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:06.846136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:06.846770 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:06.850312 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:06.862665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:06.866500 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:06.870661 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:06.871580 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:06.872695 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:06.875357 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:06.883032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:06.893635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7b9cfe01-cef3-4e10-8914-0aaa799fe088 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1298 microversion: 2.1 time: 0.295921 Aug 23 16:39:06.907269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 40/72] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:06 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1298 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:07.165737 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:07.166404 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:07.187645 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:07.193197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:07.193197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:07.193981 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:07.194480 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:07.194926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:08.109067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:08.124413 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c3db185a-dc95-4cb6-854f-ca32ed3d9776 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 1.282034 Aug 23 16:39:08.132963 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 33/73] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:06 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:08.133173 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:08.140781 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:08.141617 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:08.145703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-99dabbf2-fdd8-4fe1-b54e-32f5fdec421b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.984315 Aug 23 16:39:08.164053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:08.164586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:08.167594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:08.168456 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:08.169286 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:08.170295 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:08.175949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 41/74] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:07 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:08.440518 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-9214048f-b231-42e5-adf4-438d6553fa67 req-b0954f68-b0bd-427c-8017-0c77cfd13b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e652ad27-aa55-41e5-ba8e-5110c204c128", "tag": "ea460abd-9103-4311-9677-c18e10db6641"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:08.463551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-9214048f-b231-42e5-adf4-438d6553fa67 req-b0954f68-b0bd-427c-8017-0c77cfd13b2d service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:08.464413 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-9214048f-b231-42e5-adf4-438d6553fa67 req-b0954f68-b0bd-427c-8017-0c77cfd13b2d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:08.465896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-9214048f-b231-42e5-adf4-438d6553fa67 req-b0954f68-b0bd-427c-8017-0c77cfd13b2d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:08.501755 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-9214048f-b231-42e5-adf4-438d6553fa67 req-b0954f68-b0bd-427c-8017-0c77cfd13b2d service nova] Creating event network-changed:ea460abd-9103-4311-9677-c18e10db6641 for instance e652ad27-aa55-41e5-ba8e-5110c204c128 on hv-cinder-85032 Aug 23 16:39:08.523541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-9214048f-b231-42e5-adf4-438d6553fa67 req-b0954f68-b0bd-427c-8017-0c77cfd13b2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345811 Aug 23 16:39:08.524595 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 42/75] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:08.534799 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:08.537736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:08.545934 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:08.546660 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:08.547349 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:08.555142 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:08.556218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:08.556955 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:08.778107 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:08.790682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bfe92b16-8bac-477e-8333-ca2cd4696997 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1296 microversion: 2.1 time: 0.264601 Aug 23 16:39:08.792799 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 43/76] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:08 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1296 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:09.012111 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:09.020200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3a12c826-3571-4194-bfa9-cd9474f89ad1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.885225 Aug 23 16:39:09.041130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 34/77] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:08 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:09.150827 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:09.152316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:09.169361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:09.169989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:09.174078 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:09.176829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:09.180189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:09.180685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:09.183956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:09.185547 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:09.189811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:09.189811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:09.189811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:09.194951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:09.195855 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:09.200063 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:09.746229 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:09.759175 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0931be1c-f702-4c41-898f-8271e82305f3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.591068 Aug 23 16:39:09.762178 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 35/78] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:09 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:09.826877 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:09.827536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:09.842090 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:09.846949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:09.848027 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:09.851945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:09.855255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:09.855928 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:09.939031 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:09.979489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dfac7232-baa9-4eb9-bb73-41d20e0e2e4c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.833681 Aug 23 16:39:09.981670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 44/79] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:09 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:10.043572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:10.044409 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:10.057558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:10.058747 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:10.060455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:10.064509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:10.066340 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:10.067348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:10.693759 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:10.694394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:10.697973 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:10.704442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e284f8a9-c299-446d-b253-b1c414ad4b2f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.664459 Aug 23 16:39:10.707879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 45/80] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:10 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:10.717599 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-95e04317-7d5f-47a3-911e-d3e5a14edb3d req-cd4eb9e1-2498-4369-ac81-868138ee0bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6bc7e3a-0456-408f-9de6-b4d4c33413b0", "tag": "3bf78c41-01be-47d2-b25e-2f22c04fe90d"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:10.733241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:10.734757 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-fdff1301-181b-4527-9df4-bff62b8b2cd4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.922418 Aug 23 16:39:10.736109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 36/81] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:09 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:10.744884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-95e04317-7d5f-47a3-911e-d3e5a14edb3d req-cd4eb9e1-2498-4369-ac81-868138ee0bb8 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:10.745466 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-95e04317-7d5f-47a3-911e-d3e5a14edb3d req-cd4eb9e1-2498-4369-ac81-868138ee0bb8 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:10.745997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-95e04317-7d5f-47a3-911e-d3e5a14edb3d req-cd4eb9e1-2498-4369-ac81-868138ee0bb8 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:10.776517 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-95e04317-7d5f-47a3-911e-d3e5a14edb3d req-cd4eb9e1-2498-4369-ac81-868138ee0bb8 service nova] Creating event network-changed:3bf78c41-01be-47d2-b25e-2f22c04fe90d for instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 on hv-cinder-85032 Aug 23 16:39:10.791476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:10.792084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:10.807798 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:10.807798 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:10.807798 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:10.808106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-95e04317-7d5f-47a3-911e-d3e5a14edb3d req-cd4eb9e1-2498-4369-ac81-868138ee0bb8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094202 Aug 23 16:39:10.808239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:10.808239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:10.808413 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 46/82] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:10.808511 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:11.007822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:11.014882 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:11.033806 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:11.040266 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:11.042364 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:11.048685 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:11.050970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:11.053648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:11.079169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:11.104192 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=30 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:11.256619 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:11.265447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-819781a8-1405-412e-b8cc-3f3085339388 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.478623 Aug 23 16:39:11.269535 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 37/83] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:10 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:11.432310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:11.442830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b6535f4c-9a8f-4aa6-b5d2-fb617bc83cc0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.444806 Aug 23 16:39:11.458266 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 47/84] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:10 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:11.731963 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:11.732757 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:11.749089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:11.758680 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:11.760111 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:11.765920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:11.768445 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:11.769398 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:11.773357 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:11.777343 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:11.779372 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:11.787254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:11.789998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:11.790946 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:11.791635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:11.792249 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:11.825013 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=94 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:12.336538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=24 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:12.524545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:12.532540 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-db9377b0-4abc-4611-800c-71e42e458499 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.779929 Aug 23 16:39:12.533129 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 48/85] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:11 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:12.535185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:12.542240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:12.547143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:12.554842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a24b41e9-6b04-461f-8952-c7379140b3ef tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.825082 Aug 23 16:39:12.554842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 38/86] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:11 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:12.555055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:12.555055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:12.555221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:12.555939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:12.556432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:12.557040 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:12.559364 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-b0c97e21-795d-4a68-908d-604c4b782a66 req-922fe42d-6150-44ec-9bbc-60ec63ea6870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abfc7760-8432-47e6-b2a3-b4052a52201f", "tag": "e562daf2-33d4-4bb1-8e1b-b8386367dab6"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:12.591254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-b0c97e21-795d-4a68-908d-604c4b782a66 req-922fe42d-6150-44ec-9bbc-60ec63ea6870 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:12.592210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-b0c97e21-795d-4a68-908d-604c4b782a66 req-922fe42d-6150-44ec-9bbc-60ec63ea6870 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:12.594038 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-b0c97e21-795d-4a68-908d-604c4b782a66 req-922fe42d-6150-44ec-9bbc-60ec63ea6870 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:12.632004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-b0c97e21-795d-4a68-908d-604c4b782a66 req-922fe42d-6150-44ec-9bbc-60ec63ea6870 service nova] Creating event network-changed:e562daf2-33d4-4bb1-8e1b-b8386367dab6 for instance abfc7760-8432-47e6-b2a3-b4052a52201f on hv-cinder-85032 Aug 23 16:39:12.633547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-b0c97e21-795d-4a68-908d-604c4b782a66 req-922fe42d-6150-44ec-9bbc-60ec63ea6870 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=133199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 16:39:12.636746 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-b0c97e21-795d-4a68-908d-604c4b782a66 req-922fe42d-6150-44ec-9bbc-60ec63ea6870 service nova] Acquired lock "compute-rpcapi-router" {{(pid=133199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 16:39:12.639109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-64ed8977-9adf-4d53-93cd-eabf05c3d2d9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:12.644995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-64ed8977-9adf-4d53-93cd-eabf05c3d2d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:12.644995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-64ed8977-9adf-4d53-93cd-eabf05c3d2d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:12.644995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-64ed8977-9adf-4d53-93cd-eabf05c3d2d9 None None] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:12.644995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-64ed8977-9adf-4d53-93cd-eabf05c3d2d9 None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:12.644995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-64ed8977-9adf-4d53-93cd-eabf05c3d2d9 None None] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:12.655530 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.compute.rpcapi [None req-64ed8977-9adf-4d53-93cd-eabf05c3d2d9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 16:39:12.657004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-64ed8977-9adf-4d53-93cd-eabf05c3d2d9 None None] Releasing lock "compute-rpcapi-router" {{(pid=133199) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 16:39:12.681116 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-64ed8977-9adf-4d53-93cd-eabf05c3d2d9 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125495 Aug 23 16:39:12.681736 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 39/87] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:12.690773 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:12.691584 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:12.698721 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:12.702475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:12.702475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:12.702475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:12.702475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:12.703005 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:12.751234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:12.773586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3ec2d27b-7242-4053-a0ec-a4185fd87503 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.229584 Aug 23 16:39:12.773586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 49/88] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:12 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:12.828232 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-c14a8108-c13c-49e5-b6c5-d6612806f752 req-6e2cfa4d-502c-459b-91ed-b209ddd33531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf88c183-6ffb-49b3-88b4-1813e0e5aeec", "tag": "45eb8b58-4ba5-4b31-9a39-10f2210f3a27"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:12.854654 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-c14a8108-c13c-49e5-b6c5-d6612806f752 req-6e2cfa4d-502c-459b-91ed-b209ddd33531 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:12.858033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-c14a8108-c13c-49e5-b6c5-d6612806f752 req-6e2cfa4d-502c-459b-91ed-b209ddd33531 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:12.858893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-c14a8108-c13c-49e5-b6c5-d6612806f752 req-6e2cfa4d-502c-459b-91ed-b209ddd33531 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:12.881356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-c14a8108-c13c-49e5-b6c5-d6612806f752 req-6e2cfa4d-502c-459b-91ed-b209ddd33531 service nova] Creating event network-changed:45eb8b58-4ba5-4b31-9a39-10f2210f3a27 for instance bf88c183-6ffb-49b3-88b4-1813e0e5aeec on hv-cinder-85032 Aug 23 16:39:12.894761 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-c14a8108-c13c-49e5-b6c5-d6612806f752 req-6e2cfa4d-502c-459b-91ed-b209ddd33531 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069860 Aug 23 16:39:12.895392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 50/89] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:39:12.922279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:12.931156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d96a755e-275f-4a5d-a4c7-12652c6b90c5 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.244838 Aug 23 16:39:12.931989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 40/90] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:12 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:13.552303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=6 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:13.556915 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:13.557729 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:13.565559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:13.571714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:13.571714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:13.571714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:13.571714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:13.572457 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:13.575155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:13.576500 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:13.585877 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:13.586930 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:13.587382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:13.588096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:13.588584 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:13.589040 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:13.801159 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:13.805275 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:13.813483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-34df786b-1f24-483b-af9c-dc8038c2004e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.242263 Aug 23 16:39:13.814072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 41/91] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:13 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:13.828339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2548f7d7-078f-4200-91a2-b3847abc5532 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.276325 Aug 23 16:39:13.830432 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:13.831130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:13.838513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:13.839140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:13.839699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:13.840692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:13.841442 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:13.842070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:13.842193 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 51/92] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:13 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:13.965853 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:13.966661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:13.980576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:13.981608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:13.982968 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:13.986354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:13.987335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:13.988294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:14.019994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:14.032636 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d42e2ddc-70a4-4636-b54d-322f709076a4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.217427 Aug 23 16:39:14.033522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 42/93] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:13 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:14.300816 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:14.316635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c2326d7d-7a4e-486d-a519-cf465df106a0 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.359772 Aug 23 16:39:14.317447 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 52/94] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:13 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:14.861535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:14.862734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:14.871043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:14.872652 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:14.885407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:14.886845 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:14.887984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:14.889677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:14.891008 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:14.891458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:14.892605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:14.892793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:14.893260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:14.894204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:14.895791 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:14.896673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:15.135229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:15.140978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4745475d-922b-4457-a18f-533abd6a5245 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.294536 Aug 23 16:39:15.142783 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 53/95] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:14 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:15.144832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:15.152261 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:15.153692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:15.156901 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1510dad0-bb74-4e2a-978a-035c29f30ca2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.325227 Aug 23 16:39:15.168816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 43/96] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:14 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:15.176403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:15.176906 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:15.177351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:15.181346 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:15.181946 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:15.182254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:15.336627 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:15.342446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:15.343357 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:15.345113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8c4af8bb-66e1-4863-beae-e315f60dae7e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.196592 Aug 23 16:39:15.345711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 54/97] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:15 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:15.350734 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:15.351496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:15.352010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:15.352824 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:15.353350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:15.353984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:15.498951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:15.507794 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a1424315-93b7-41ec-9529-9df334231331 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.171175 Aug 23 16:39:15.508410 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 44/98] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:15 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:16.164258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:16.164910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:16.171339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:16.171898 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:16.172533 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:16.187181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:16.187181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:16.187181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:16.187907 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:16.187907 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:16.187907 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:16.187907 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:16.188682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:16.188682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:16.188682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:16.188682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:16.377578 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:16.391442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4627dcd9-953a-4bf9-8145-7d2292855155 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.231817 Aug 23 16:39:16.392305 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 55/99] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:16 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:16.404366 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:16.408988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c0faae11-6833-4438-994a-c17b35e8c527 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.233908 Aug 23 16:39:16.412955 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:16.413683 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:16.421055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:16.421554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:16.421993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:16.423004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:16.423486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 45/100] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:16 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:16.424103 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:16.424583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:16.529851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:16.530965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:16.538975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:16.540426 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:16.541260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:16.542835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:16.544141 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:16.544890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:16.576632 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:16.585902 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6a3cb9a6-f862-4565-a5b2-c563df0582a1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.181695 Aug 23 16:39:16.586771 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 56/101] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:16 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:16.699646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:16.708053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7de07845-378e-4a8d-896f-826c88f87535 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.182445 Aug 23 16:39:16.709923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 46/102] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:16 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:17.413377 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:17.413988 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:17.419975 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:17.420504 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:17.420939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:17.421630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:17.422081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:17.422505 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:17.434743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:17.435848 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:17.444454 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:17.445140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:17.445944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:17.447170 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:17.448524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:17.449107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:17.645542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:17.649462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:17.656841 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3c433b08-d181-44f2-8731-14b8062e5f57 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.228662 Aug 23 16:39:17.657296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c040db36-5709-4aad-a2a7-08f7ded144b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.247747 Aug 23 16:39:17.657523 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 47/103] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:17 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:17.657929 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 57/104] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:17 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:17.663374 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:17.664207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:17.672704 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:17.673312 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:17.673850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:17.674668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:17.675210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:17.675702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:17.730483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:17.730998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:17.755414 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:17.755926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:17.756398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:17.759074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:17.759545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:17.759984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:17.856047 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:17.863867 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-22a538e2-724d-4e38-8a37-b3462fc384f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.205198 Aug 23 16:39:17.868513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 48/105] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:17 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:17.976610 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:17.992831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-18204922-a4e3-4571-b3f6-ed3a7418fe63 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.265708 Aug 23 16:39:17.994690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 58/106] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:17 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:18.678948 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:18.679559 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:18.681550 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:18.682301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:18.685828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:18.686397 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:18.686833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:18.687522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:18.687970 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:18.688418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:18.688758 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:18.689248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:18.689693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:18.690391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:18.690851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:18.691278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:18.905048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:18.915166 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0bee4eda-ad74-4fe5-a651-1ac1b023d012 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.237496 Aug 23 16:39:18.918908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:18.926995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c43827ce-0ddb-4a06-b6ef-b1677755520c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.251971 Aug 23 16:39:18.927565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 49/107] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:18 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:18.936318 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 59/108] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:18 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:18.936318 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:18.936763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:18.956081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:18.956742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:18.957278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:18.958078 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:18.959161 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:18.959675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:19.030554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:19.031196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:19.037250 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:19.037743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:19.038187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:19.039170 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:19.039440 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:19.042451 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:19.125827 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:19.136085 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d5366ca4-28c3-4286-a20d-6cdd4164af9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.206197 Aug 23 16:39:19.136734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 60/109] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:18 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:19.204312 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:19.215391 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ce1f44bc-a062-410e-af7c-3612ddf9fde4 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.188606 Aug 23 16:39:19.216130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 50/110] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:19 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:19.864250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-e1e7e18b-58b1-4a45-a931-160c2af5cb75 req-051acaa9-1e0d-4c69-a258-b4b3e8806c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c4b544-8888-42a5-9d5e-2add07e40c69", "name": "network-vif-plugged", "status": "completed", "tag": "957d3383-6848-4d1d-8aca-dbef211d2c23"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:19.874769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e1e7e18b-58b1-4a45-a931-160c2af5cb75 req-051acaa9-1e0d-4c69-a258-b4b3e8806c7b service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:19.875243 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e1e7e18b-58b1-4a45-a931-160c2af5cb75 req-051acaa9-1e0d-4c69-a258-b4b3e8806c7b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:19.875767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e1e7e18b-58b1-4a45-a931-160c2af5cb75 req-051acaa9-1e0d-4c69-a258-b4b3e8806c7b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:19.887923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-e1e7e18b-58b1-4a45-a931-160c2af5cb75 req-051acaa9-1e0d-4c69-a258-b4b3e8806c7b service nova] Creating event network-vif-plugged:957d3383-6848-4d1d-8aca-dbef211d2c23 for instance a9c4b544-8888-42a5-9d5e-2add07e40c69 on hv-cinder-85032 Aug 23 16:39:19.893134 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-e1e7e18b-58b1-4a45-a931-160c2af5cb75 req-051acaa9-1e0d-4c69-a258-b4b3e8806c7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114042 Aug 23 16:39:19.893732 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 61/111] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:19.943928 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:19.945253 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:19.952248 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:19.952978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:19.953551 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:19.953743 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:19.954749 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:19.954838 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:19.954920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:19.962430 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:19.986735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:19.987229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:19.987663 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:19.988436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:19.988844 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:19.989423 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:20.194606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:20.199687 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:20.211381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-863b6499-c549-4bca-80ae-791a8f6fbbec tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.262851 Aug 23 16:39:20.213415 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9660fdf7-985f-43cf-89c9-73e59980d010 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.274682 Aug 23 16:39:20.224806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 51/112] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:19 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:20.224806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:20.224806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:20.232268 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 62/113] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:19 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:20.232455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:20.232455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:20.237009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:20.237009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:20.237009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:20.237009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:20.237856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:20.238475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:20.246695 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:20.247233 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:20.247889 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:20.248619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:20.249078 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:20.249505 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:20.449009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:20.458196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d94fc2b1-7c3a-41f5-bc7c-b3d19296df85 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.242508 Aug 23 16:39:20.459298 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 52/114] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:20 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:20.464617 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:20.472852 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1a38e91b-cbac-41b2-970c-429b52e17ccb tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.239465 Aug 23 16:39:20.473438 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 63/115] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:20 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:21.233360 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:21.233976 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:21.241000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:21.241572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:21.242107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:21.242881 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:21.243403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:21.243917 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:21.247340 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:21.247964 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:21.255868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:21.256598 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:21.257044 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:21.257753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:21.258218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:21.258643 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:21.281383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:21.484762 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:21.489113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:21.497768 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b7666beb-6e27-4d78-9b72-2fd028dc2331 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.268451 Aug 23 16:39:21.497960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1ac7e43e-6444-43a0-ba66-402b0990f305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.254839 Aug 23 16:39:21.509963 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 64/116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:21 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:21.513124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 53/117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:21 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:21.516757 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:21.518138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:21.518939 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:21.519559 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:21.529542 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:21.530059 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:21.530553 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:21.530836 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:21.530978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:21.531303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:21.531923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:21.532102 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:21.532409 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:21.532823 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:21.532960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:21.533358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:21.747030 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:21.756022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:21.762241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8b294fc5-8a15-41aa-9814-8441903f73d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.251113 Aug 23 16:39:21.763015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 65/118] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:21 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:21.764441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d986eb11-ecd2-459d-ac4c-64442a433d9a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.250151 Aug 23 16:39:21.765070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 54/119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:21 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:22.521993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:22.522608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:22.523870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:22.525026 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:22.529357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:22.529848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:22.530288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:22.530991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:22.531441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:22.531868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:22.531959 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:22.532540 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:22.533259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:22.534185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:22.534869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:22.535401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:22.558616 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:22.653638 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:22.753753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:22.757740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:22.763901 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5a6d7d7b-daa5-48fd-b74d-2c7fb03d2a22 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.246067 Aug 23 16:39:22.764554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 66/120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:22 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:22.766145 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-dfdb38e7-34e2-4e61-9041-222a82c03247 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.246079 Aug 23 16:39:22.771760 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 55/121] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:22 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:22.784468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:22.784735 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:22.785218 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:22.785402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:22.792360 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:22.792647 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:22.792851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:22.793069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:22.793289 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:22.793669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:22.794006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:22.794459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:22.794619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:22.794885 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:22.795138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:22.795636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:22.996760 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:23.005706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bff4944e-9d3b-4d43-ab18-ee5c8426b8c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.225375 Aug 23 16:39:23.006508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 67/122] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:22 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:23.010622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:23.019537 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-564437f8-a2c2-40bc-af7a-9802d0afb726 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.238491 Aug 23 16:39:23.019945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 56/123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:22 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:23.785284 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:23.786022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:23.787371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:23.787983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:23.792366 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:23.792928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:23.793449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:23.794213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:23.794673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:23.794933 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:23.795159 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:23.795493 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:23.795621 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:23.796360 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:23.796815 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:23.797234 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:23.993882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:23.997686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:24.006432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-81150493-85e9-496c-9e06-e695966d939b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.225294 Aug 23 16:39:24.007738 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 68/124] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:23 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:24.010747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0e5e95e0-18ab-40a1-88fe-82d1f571e669 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.227726 Aug 23 16:39:24.011329 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 57/125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:23 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:24.026613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:24.027223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:24.033302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:24.033792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:24.034222 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:24.034977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:24.035508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:24.035849 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:24.040905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:24.041596 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:24.048113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:24.048635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:24.049074 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:24.049780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:24.050238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:24.050662 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:24.235750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:24.237713 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:24.244625 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-28a59c90-fc0b-402c-b889-3f71341bdcd7 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.207496 Aug 23 16:39:24.245140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 58/126] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:24 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:24.245521 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ef41bffa-6bf3-4387-bb55-65d055ad7e48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.222640 Aug 23 16:39:24.246082 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 69/127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:24 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:25.027053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:25.027682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:25.033801 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:25.034305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:25.034837 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:25.035553 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:25.036217 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:25.037263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:25.044374 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:25.044980 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:25.050891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:25.051379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:25.051813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:25.053094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:25.053544 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:25.053965 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:25.243319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:25.247401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:25.251170 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-55fa5b23-8d4f-48e6-ac7d-6626292ae6f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.228010 Aug 23 16:39:25.251911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 59/128] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:25 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:25.255667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ec75d854-4dff-4cc6-986c-05d094714839 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.215144 Aug 23 16:39:25.268271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 70/129] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:25 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:25.271956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:25.272780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:25.273780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:25.274401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:25.278891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:25.279383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:25.279864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:25.280658 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:25.280872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:25.281113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:25.281447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:25.281559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:25.281800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:25.282491 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:25.282932 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:25.283342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:25.481920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:25.483767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:25.488575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cd1b5e68-5a83-449a-a98d-4aa9bc1e0a83 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.222318 Aug 23 16:39:25.490028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 60/130] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:25 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:25.494339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-085afa00-9c5f-40e9-8457-19100b998f2d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.229029 Aug 23 16:39:25.494921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 71/131] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:25 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:26.274256 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:26.275114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:26.276064 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:26.276708 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:26.280982 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:26.281559 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:26.281910 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:26.282644 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:26.282753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:26.288408 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:26.288542 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:26.288631 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:26.288711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:26.288711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:26.288711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:26.288711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:26.498004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:26.502443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:26.507420 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-88f823a2-68dd-4a5b-8d64-d9b78cc978c6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.235038 Aug 23 16:39:26.508245 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 72/132] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:26 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:26.512563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b2075972-fd2b-4d2e-b6c5-93a3855437cf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.242475 Aug 23 16:39:26.519200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 61/133] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:26 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:26.519401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:26.519544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:26.519544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:26.520563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:26.525633 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:26.526099 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:26.526627 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:26.527328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:26.527876 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:26.528345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:26.531752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:26.532379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:26.532922 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:26.533703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:26.534224 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:26.534646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:26.737884 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:26.741928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:26.747137 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3116fa03-5a7e-4b70-988b-8a3137faaa5a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.232963 Aug 23 16:39:26.748481 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 62/134] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:26 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:26.750593 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0cdb3893-fa53-44e1-a6ea-5ddd7cc856d3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.240923 Aug 23 16:39:26.751277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 73/135] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:26 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:27.529389 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:27.530025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:27.534774 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:27.535397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:27.536195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:27.537224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:27.537708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:27.538412 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:27.538866 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:27.539288 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:27.542347 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:27.542839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:27.543277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:27.544015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:27.544499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:27.544930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:27.937745 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:27.942010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:27.951703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-04acbc06-0b6c-4b5e-a71b-d5c8813856d2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.426087 Aug 23 16:39:27.952446 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1a9ce146-9bb6-4c55-9af5-23b6443148ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.421335 Aug 23 16:39:27.964206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 63/136] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:27 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:27.964206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:27.964206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:27.970376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 74/137] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:27 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:27.970635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:27.970635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:27.970635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:27.971238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:27.971691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:27.972202 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:27.972313 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:27.972983 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:27.981015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:27.981485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:27.981936 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:27.983302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:27.983765 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:27.984659 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:28.190753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:28.200951 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2e134684-7784-462b-aec6-07b41794d44a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.235203 Aug 23 16:39:28.201785 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 75/138] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:27 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:28.207262 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-184735f4-7295-4c21-907b-ecf61bd4d168 req-fd41c5a6-efb0-4fd9-bb6a-b5d0a07831cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e652ad27-aa55-41e5-ba8e-5110c204c128", "name": "network-vif-plugged", "status": "completed", "tag": "ea460abd-9103-4311-9677-c18e10db6641"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:28.211600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:28.217457 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-184735f4-7295-4c21-907b-ecf61bd4d168 req-fd41c5a6-efb0-4fd9-bb6a-b5d0a07831cd service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:28.218067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-184735f4-7295-4c21-907b-ecf61bd4d168 req-fd41c5a6-efb0-4fd9-bb6a-b5d0a07831cd service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:28.218496 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-184735f4-7295-4c21-907b-ecf61bd4d168 req-fd41c5a6-efb0-4fd9-bb6a-b5d0a07831cd service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:28.219627 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-73347aa9-727d-4237-8d59-8aab8c641e89 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.265069 Aug 23 16:39:28.220246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 64/139] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:27 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:28.230650 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-184735f4-7295-4c21-907b-ecf61bd4d168 req-fd41c5a6-efb0-4fd9-bb6a-b5d0a07831cd service nova] Creating event network-vif-plugged:ea460abd-9103-4311-9677-c18e10db6641 for instance e652ad27-aa55-41e5-ba8e-5110c204c128 on hv-cinder-85032 Aug 23 16:39:28.235647 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-184735f4-7295-4c21-907b-ecf61bd4d168 req-fd41c5a6-efb0-4fd9-bb6a-b5d0a07831cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032662 Aug 23 16:39:28.236269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 76/140] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:28.977909 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:28.978784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:28.979282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:28.980416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:28.985309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:28.985800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:28.986235 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:28.987121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:28.987507 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:28.987929 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:28.989240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:28.989920 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:28.990491 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:28.991352 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:28.992001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:28.992587 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:29.218680 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:29.222512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:29.232434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e4fb11e7-9086-40a3-a54f-c017ef5229d6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.259164 Aug 23 16:39:29.233412 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 65/141] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:28 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:29.235637 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d18d3835-9778-4131-ad24-95a1e929679c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.261130 Aug 23 16:39:29.248207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 77/142] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:28 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:29.249369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:29.249369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:29.255004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:29.256100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:29.257684 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:29.261504 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:29.261504 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:29.261504 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:29.261504 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:29.261819 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:29.265893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:29.266752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:29.267501 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:29.268656 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:29.269244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:29.269723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:29.490851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:29.494010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:29.499184 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7e04042d-ec99-4546-82c8-37d2ad5c4033 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.264427 Aug 23 16:39:29.499774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 66/143] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:29 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:29.507803 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dfc627cf-4e9d-416f-a568-8282561fd7ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.269321 Aug 23 16:39:29.508702 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 78/144] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:29 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:30.257200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:30.257811 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:30.262081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:30.262692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:30.263801 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:30.264315 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:30.264743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:30.265427 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:30.265871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:30.266289 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:30.268524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:30.269006 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:30.269436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:30.270116 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:30.270657 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:30.271734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:30.461937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:30.467161 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:30.469911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f86acb16-60be-4263-aa14-25fbdce0eb0e tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.217190 Aug 23 16:39:30.470503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 67/145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:30 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:30.475783 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d41ac121-4563-4a16-b4f6-3ebc5b0f6746 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.217335 Aug 23 16:39:30.476481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 79/146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:30 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:30.525568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:30.526175 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:30.528372 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:30.528989 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:30.533119 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:30.533608 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:30.534675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:30.535007 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:30.535423 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:30.535550 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:30.535872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:30.535996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:30.536815 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:30.537143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:30.537605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:30.538032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:30.736282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:30.744715 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-92b78717-5db8-437c-a61f-d305c783964b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.223633 Aug 23 16:39:30.745983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 68/147] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:30 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:30.748598 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:30.757333 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-92be2f40-f545-45ca-b913-25fc240427b5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.232598 Aug 23 16:39:30.757937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 80/148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:30 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:31.491586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:31.492143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:31.495985 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:31.496640 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:31.498905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:31.499393 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:31.499828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:31.500548 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:31.501000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:31.501422 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:31.502449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:31.502928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:31.503361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:31.504045 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:31.504560 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:31.504945 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:31.698728 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:31.702277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:31.702809 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:31.706872 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fb55b105-8d5a-4ed6-a44d-fc0daf61bb2d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.214598 Aug 23 16:39:31.707500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 81/149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:31 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:31.711410 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4b60e955-fea8-4c44-91d5-e4d8cd4d9038 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.224345 Aug 23 16:39:31.714550 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 69/150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:31 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:31.766503 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:31.767118 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:31.774152 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:31.774646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:31.775086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:31.775784 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:31.776264 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:31.776697 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:31.780793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:31.781398 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:31.787265 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:31.787738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:31.788186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:31.788875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:31.789317 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:31.789747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:31.985781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:31.993427 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:31.993605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-689ca594-14cf-4c19-923f-500d8ae41eb8 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.231140 Aug 23 16:39:31.994191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 82/151] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:31 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:32.001820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c160caf9-53da-45b1-b6d6-1e05d01470a8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.224723 Aug 23 16:39:32.002400 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 70/152] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:31 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:32.734439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:32.735211 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:32.735573 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:32.735665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:32.741078 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:32.741231 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:32.741556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:32.741709 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:32.742002 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:32.742142 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:32.742671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:32.742951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:32.743768 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:32.743905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:32.744208 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:32.744510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:32.954508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:32.957921 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:32.963061 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c572825e-f7b3-4dc0-8703-1a067d841dff tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.232466 Aug 23 16:39:32.963826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 83/153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:32 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:32.966891 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-880c52ee-cc86-4daf-9b13-7afab9c865dc tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.236187 Aug 23 16:39:32.967474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 71/154] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:32 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:33.015015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:33.015630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:33.021960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:33.022448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:33.022632 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:33.022884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:33.023268 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:33.023581 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:33.024038 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:33.025021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:33.029886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:33.033186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:33.033186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:33.033186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:33.033186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:33.033536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:33.036406 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:33.220144 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:33.223531 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:33.228211 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-decbc978-8f1f-488f-8e80-5e6a9d94d540 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.209338 Aug 23 16:39:33.228790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 72/155] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:33 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:33.231634 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9b96cba7-4292-4719-9d91-521953c74dac tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.220465 Aug 23 16:39:33.232269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 84/156] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:33 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:33.985831 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:33.986357 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:33.989189 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:33.989805 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:33.992517 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:33.993032 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:33.999829 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:33.999829 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:33.999829 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:33.999829 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:34.000197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:34.000197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:34.000197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:34.000197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:34.000575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:34.000575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:34.191794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:34.196041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:34.204471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-76aea68f-e914-45d4-a42a-d1040330890d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.219063 Aug 23 16:39:34.204927 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-fb47a0ab-613e-4dab-93a7-4b840dbacb66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.224650 Aug 23 16:39:34.205244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 85/157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:33 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:34.221465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 73/158] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:33 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:34.250484 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:34.251096 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:34.253080 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:34.253719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:34.259002 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:34.259577 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:34.259920 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:34.260039 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:34.261108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:34.261507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:34.261613 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:34.262776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:34.263565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:34.264362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:34.265724 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:34.266171 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:34.484356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:34.486822 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-72b96461-47e4-49b1-ab90-da34c62e77ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.238550 Aug 23 16:39:34.487406 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 74/159] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:34 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:34.491670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:34.500209 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-710c6249-df6e-450e-a9a2-f85b33a77507 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.253836 Aug 23 16:39:34.500835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 86/160] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:34 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:35.226852 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:35.227460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:35.234348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:35.234505 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:35.234897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:35.234988 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:35.235365 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:35.236044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:35.236492 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:35.236915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:35.241010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:35.241497 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:35.241921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:35.242766 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:35.243366 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:35.243941 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:35.443454 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:35.446819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:35.453823 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-05f4b189-6d4a-4c76-bca1-50ec28844dc4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.231188 Aug 23 16:39:35.456656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 75/161] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:35 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:35.457008 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-03bbacd6-b6e6-4eb1-bd3c-a18169278eca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.226924 Aug 23 16:39:35.457668 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 87/162] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:35 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:35.508107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:35.508761 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:35.515553 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:35.516087 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:35.516562 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:35.517258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:35.517705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:35.518124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:35.522516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:35.523372 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:35.531362 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:35.531952 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:35.532491 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:35.533439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:35.533930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:35.534415 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:35.730376 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:35.737812 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:35.738349 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f2f34c47-ecfb-4833-82ba-e44c729cfbbd tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.234057 Aug 23 16:39:35.740918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 76/163] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:35 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:35.745615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bcdd4ee2-4f09-47ff-bae2-444f7e111763 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.227235 Aug 23 16:39:35.746656 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 88/164] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:35 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:36.500857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:36.513248 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:36.513441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:36.517788 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:36.544095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:36.544095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:36.544095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:36.544095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:36.544874 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:36.544874 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:36.545734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:36.546312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:36.546933 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:36.547763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:36.548316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:36.548825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:36.775260 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:36.784131 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-525d185a-8b3e-4ef3-a3ec-e9a873a7dfad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.309966 Aug 23 16:39:36.784739 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 89/165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:36 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:36.789498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-190c0e58-0610-46fc-be9b-572d585aa4bb req-8b274b0e-62a1-4725-986b-61bc013e6c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bc7e3a-0456-408f-9de6-b4d4c33413b0", "name": "network-vif-plugged", "status": "completed", "tag": "3bf78c41-01be-47d2-b25e-2f22c04fe90d"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:36.799511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-190c0e58-0610-46fc-be9b-572d585aa4bb req-8b274b0e-62a1-4725-986b-61bc013e6c6b service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:36.799991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-190c0e58-0610-46fc-be9b-572d585aa4bb req-8b274b0e-62a1-4725-986b-61bc013e6c6b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:36.800475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-190c0e58-0610-46fc-be9b-572d585aa4bb req-8b274b0e-62a1-4725-986b-61bc013e6c6b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:36.811532 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-190c0e58-0610-46fc-be9b-572d585aa4bb req-8b274b0e-62a1-4725-986b-61bc013e6c6b service nova] Creating event network-vif-plugged:3bf78c41-01be-47d2-b25e-2f22c04fe90d for instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 on hv-cinder-85032 Aug 23 16:39:36.812778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:36.816859 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-190c0e58-0610-46fc-be9b-572d585aa4bb req-8b274b0e-62a1-4725-986b-61bc013e6c6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030589 Aug 23 16:39:36.817446 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 90/166] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:36.821605 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c7e2681b-da1f-44ef-8cc0-ade42a122079 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.349153 Aug 23 16:39:36.822186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 77/167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:36 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:36.822616 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:36.823370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:36.828153 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:36.828787 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:36.831604 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:36.832411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:36.833076 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:36.833956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:36.834548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:36.835176 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:36.836583 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:36.847612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:36.847612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:36.847612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:36.847612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:36.847925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:37.082151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:37.094100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7f4edd49-0413-4e6c-9ac7-fea774a9994c tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.275356 Aug 23 16:39:37.094779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 91/168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:36 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:37.095238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:37.104852 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8ee225ad-fea2-4fe8-ad3b-fee165afec21 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.281616 Aug 23 16:39:37.105405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 78/169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:36 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:37.805485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:37.806127 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:37.812132 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:37.812655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:37.813098 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:37.813787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:37.814248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:37.814671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:37.844122 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:37.845409 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:37.852152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:37.852656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:37.853091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:37.853850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:37.854356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:37.854703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:38.010818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:38.019400 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dc93b92a-ab7e-406e-a62c-f8c0572a3d6d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.217747 Aug 23 16:39:38.026443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 92/170] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:37 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:38.042714 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:38.050502 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7a52b058-aa29-425e-8a3a-37dbb8c5df9f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.210984 Aug 23 16:39:38.051083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 79/171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:37 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:38.115718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:38.116353 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:38.123876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:38.124701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:38.125200 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:38.126082 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:38.126614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:38.127113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:38.130715 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:38.131559 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:38.138974 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:38.139462 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:38.139915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:38.140659 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:38.141214 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:38.141632 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:38.534748 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:38.539108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:38.542452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-69c81678-c4c4-498c-af3f-ddbf183ce463 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.431433 Aug 23 16:39:38.547687 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-76d9d1d0-5152-4b9a-a1e7-db9368a216f9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.420649 Aug 23 16:39:38.548372 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 80/172] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:38 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:38.548960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 93/173] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:38 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:38.833474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-c08abd66-001f-4c5f-bc78-50631a2641aa req-668d11fc-d7e0-41b0-815c-f9c4c940ccd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf88c183-6ffb-49b3-88b4-1813e0e5aeec", "name": "network-vif-plugged", "status": "completed", "tag": "45eb8b58-4ba5-4b31-9a39-10f2210f3a27"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:38.846415 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-c08abd66-001f-4c5f-bc78-50631a2641aa req-668d11fc-d7e0-41b0-815c-f9c4c940ccd2 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:38.846951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-c08abd66-001f-4c5f-bc78-50631a2641aa req-668d11fc-d7e0-41b0-815c-f9c4c940ccd2 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:38.847373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-c08abd66-001f-4c5f-bc78-50631a2641aa req-668d11fc-d7e0-41b0-815c-f9c4c940ccd2 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:38.864441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-c08abd66-001f-4c5f-bc78-50631a2641aa req-668d11fc-d7e0-41b0-815c-f9c4c940ccd2 service nova] Creating event network-vif-plugged:45eb8b58-4ba5-4b31-9a39-10f2210f3a27 for instance bf88c183-6ffb-49b3-88b4-1813e0e5aeec on hv-cinder-85032 Aug 23 16:39:38.865994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-c08abd66-001f-4c5f-bc78-50631a2641aa req-668d11fc-d7e0-41b0-815c-f9c4c940ccd2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037132 Aug 23 16:39:38.866795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 81/174] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:39.046641 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:39.047475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:39.061538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:39.062285 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:39.067777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:39.067777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:39.067777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:39.067777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:39.072334 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:39.073067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:39.075767 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=97 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:39.098970 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:39.099750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:39.100776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:39.108612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:39.109301 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:39.109823 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:39.548135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:39.555996 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:39.556533 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5bd04816-3844-4bae-ab5c-5cb112bfe72a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.514490 Aug 23 16:39:39.557104 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-16437d86-032c-41db-84cd-ac324a428f10 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.489225 Aug 23 16:39:39.557649 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 94/175] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:39 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:39.557766 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 82/176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:39 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:39.564566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:39.565392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:39.574905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:39.575520 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:39.583067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:39.583252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:39.583568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:39.583722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:39.589223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:39.589371 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:39.589463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:39.589548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:39.589630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:39.589732 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:39.590366 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:39.602910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:39.981821 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:39.992633 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:40.004037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-87b87f4f-aca9-4895-bf30-353c2f0cd8fe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.444456 Aug 23 16:39:40.004877 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 95/177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:39 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:40.027178 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-324d5762-ceb5-45fe-b31b-ee0f44b6550b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.450716 Aug 23 16:39:40.027178 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 83/178] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:39 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:40.579337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:40.579967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:40.582052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:40.593021 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:40.594163 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:40.599807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:40.600615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:40.601064 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:40.601790 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:40.602247 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:40.602676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:40.619841 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:40.622279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:40.622732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:40.624096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:40.625087 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:40.625514 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:40.921182 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:40.929494 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-53a73014-9e25-440d-8dec-e2280a17a02d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.355159 Aug 23 16:39:40.930377 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 96/179] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:40 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:40.935223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:40.945740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0baffc43-ee3c-481f-b376-b83d1e38ae0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.367677 Aug 23 16:39:40.945824 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 84/180] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:40 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:41.028259 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:41.032553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:41.034919 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:41.035411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:41.035844 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:41.036601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:41.037056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:41.037480 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:41.047490 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:41.048834 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:41.055060 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:41.055686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:41.056124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:41.056854 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:41.057492 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:41.058079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:41.242767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:41.251047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0d69db9e-5733-4dbf-9f64-fce9fa18ee8d tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.227774 Aug 23 16:39:41.252280 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 97/181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:41 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:41.263510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:41.271424 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b9870c1c-89b1-4fea-94c3-8d891ad32afe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.228847 Aug 23 16:39:41.271934 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 85/182] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:41 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:41.951429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:41.952084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:41.958224 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:41.958720 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:41.959201 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:41.959897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:41.961662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:41.961662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:41.966573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:41.967260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:41.973893 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:41.974384 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:41.981968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:41.981968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:41.981968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:41.981968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:42.190559 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:42.191538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:42.200829 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2ce91468-c9ca-41e4-a36e-f5f640d2b689 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.237938 Aug 23 16:39:42.201027 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1b4fb07b-f807-4189-ba26-413eae7e898f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.254002 Aug 23 16:39:42.201823 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 98/183] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:41 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:42.202627 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 86/184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:41 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:42.272080 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:42.272704 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:42.278655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:42.279138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:42.279572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:42.280278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:42.280731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:42.281155 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:42.290772 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:42.297263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:42.298730 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:42.305592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:42.305904 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:42.306352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:42.307042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:42.307492 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:42.307915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:42.491878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:42.493556 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:42.500604 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cb328956-f1ee-4b4c-b383-00027b5dbafe tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.232184 Aug 23 16:39:42.501200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3db73949-87dd-40bf-90ce-3574ce517c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.211882 Aug 23 16:39:42.501332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 99/185] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:42 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:42.501779 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 87/186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:42 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:43.223101 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:43.224530 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:43.228614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:43.229292 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:43.231301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:43.231788 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:43.232341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:43.233033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:43.233644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:43.234127 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:43.243157 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:43.243648 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:43.244080 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:43.247290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:43.247652 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:43.248080 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:43.467487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:43.471638 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:43.477000 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7cc952fc-8d90-4c91-9ec0-3a565598a8e0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.258774 Aug 23 16:39:43.477607 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 100/187] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:43 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:43.483011 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-ad63f8a0-757e-4c81-a94f-c269f18389c2 req-b9271da3-9cac-4be7-8446-00cb37574b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abfc7760-8432-47e6-b2a3-b4052a52201f", "name": "network-vif-plugged", "status": "completed", "tag": "e562daf2-33d4-4bb1-8e1b-b8386367dab6"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:43.483544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-69ed5823-933f-4849-a259-4f5588094385 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.260414 Aug 23 16:39:43.492194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 88/188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:43 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:43.497227 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-ad63f8a0-757e-4c81-a94f-c269f18389c2 req-b9271da3-9cac-4be7-8446-00cb37574b0e service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:43.497895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-ad63f8a0-757e-4c81-a94f-c269f18389c2 req-b9271da3-9cac-4be7-8446-00cb37574b0e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:43.498443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-ad63f8a0-757e-4c81-a94f-c269f18389c2 req-b9271da3-9cac-4be7-8446-00cb37574b0e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:43.511186 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-ad63f8a0-757e-4c81-a94f-c269f18389c2 req-b9271da3-9cac-4be7-8446-00cb37574b0e service nova] Creating event network-vif-plugged:e562daf2-33d4-4bb1-8e1b-b8386367dab6 for instance abfc7760-8432-47e6-b2a3-b4052a52201f on hv-cinder-85032 Aug 23 16:39:43.518840 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-ad63f8a0-757e-4c81-a94f-c269f18389c2 req-b9271da3-9cac-4be7-8446-00cb37574b0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039867 Aug 23 16:39:43.519525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 101/189] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:43.521916 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:43.522589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:43.525180 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:43.526071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:43.529403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:43.529830 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:43.530332 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:43.531105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:43.531628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:43.532138 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:43.533850 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:43.534510 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:43.535104 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:43.536069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:43.536704 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:43.537287 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:43.551929 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:43.746293 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:43.748760 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:43.752363 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bcbd0eae-8ead-4e4f-b40f-33645cdf6cc6 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.234769 Aug 23 16:39:43.753007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 89/190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:43 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:43.757164 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-60d9756a-1eda-4769-a187-08acd25d5bd2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.235895 Aug 23 16:39:43.758080 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 102/191] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:43 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:44.499228 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:44.499876 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:44.506266 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:44.506769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:44.507201 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:44.507893 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:44.508371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:44.508789 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:44.509740 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:44.510376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:44.516499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:44.516990 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:44.517431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:44.518129 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:44.518586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:44.519015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:44.709693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:44.718595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:44.725761 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b7414755-cfc9-4ff4-b906-06dee63185a9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1368 microversion: 2.1 time: 0.219846 Aug 23 16:39:44.726339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 103/192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:44 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:44.731858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-49084a04-4d31-4418-a90b-e06873bb49c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.236390 Aug 23 16:39:44.733065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 90/193] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:44 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:44.789183 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:44.790339 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:44.794807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:44.798341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:44.803158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:44.804068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:44.805041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:44.806811 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:44.807929 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:44.808944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:44.817916 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:44.820855 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:44.838867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:44.838867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:44.838867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:44.838867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:45.071770 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:45.076732 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:45.086503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-12be68fc-aa0b-4876-8cd0-d4acb1441904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.311301 Aug 23 16:39:45.087287 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-de01dc5c-0426-44e7-9b5f-543f3d382233 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1315 microversion: 2.1 time: 0.313946 Aug 23 16:39:45.087486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 91/194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:44 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:45.088275 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 104/195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:44 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:45.755791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:45.756922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:45.757475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:45.760672 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:45.768117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:45.768640 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:45.769065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:45.769175 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:45.769583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:45.769771 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:45.770028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:45.770399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:45.770739 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:45.771276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:45.771933 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:45.772319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:46.007071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:46.014520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:46.022973 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4412ae45-de4d-4232-8ed3-307ece45bd51 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1557 microversion: 2.1 time: 0.275688 Aug 23 16:39:46.022973 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 92/196] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:45 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1557 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:46.049063 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3dff5357-8701-4827-8d91-65f644a630c7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.297903 Aug 23 16:39:46.049752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 105/197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:45 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:46.052519 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c982864f-d262-45f3-b52e-5f0447002b4b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:46.052519 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c982864f-d262-45f3-b52e-5f0447002b4b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:46.058319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c982864f-d262-45f3-b52e-5f0447002b4b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:46.059041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c982864f-d262-45f3-b52e-5f0447002b4b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:46.059466 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c982864f-d262-45f3-b52e-5f0447002b4b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:46.060994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c982864f-d262-45f3-b52e-5f0447002b4b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:46.061635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c982864f-d262-45f3-b52e-5f0447002b4b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:46.062061 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c982864f-d262-45f3-b52e-5f0447002b4b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:46.107003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:46.108127 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:46.114352 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:46.115029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:46.115508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:46.116354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:46.116809 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:46.117259 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:46.221685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c982864f-d262-45f3-b52e-5f0447002b4b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175122 Aug 23 16:39:46.222281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 93/198] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 23 16:39:46 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:46.228192 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:46.229042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:46.236325 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:46.236858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:46.237387 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:46.238314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:46.238994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:46.239488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:46.543154 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:46.557817 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ac2554fd-b0f4-4007-9b27-d66bc2cba696 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1321 microversion: 2.1 time: 0.454497 Aug 23 16:39:46.558410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 106/199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:46 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:46.623980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:46.632233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d5870492-0006-47f0-bae8-036b31f73387 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1501 microversion: 2.1 time: 0.408071 Aug 23 16:39:46.632960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 94/200] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:46 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1501 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:47.070974 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:47.071548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:47.078921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:47.079443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:47.079861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:47.084294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:47.084294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:47.084294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:47.238062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:47.249282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f41c8e58-b069-4b51-841a-a89f57db2b66 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.182232 Aug 23 16:39:47.250094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 107/201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:47 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:47.585681 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:47.586532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:47.592703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:47.593673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:47.594356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:47.595842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:47.596545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:47.597174 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:47.817374 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:47.825587 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-58364978-bcd5-4af2-99c4-c215b0f3a49f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1516 microversion: 2.1 time: 0.243898 Aug 23 16:39:47.826683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 95/202] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:47 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:47.853455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:47.855998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:47.866802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:47.866802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:47.866802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:47.866802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:47.867214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:47.867289 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:47.880562 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-4ce4e8a0-5637-4f3c-8c38-2f63550f972d req-6203175f-dbc1-4a80-b136-c325c1c7212c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e652ad27-aa55-41e5-ba8e-5110c204c128", "tag": "ea460abd-9103-4311-9677-c18e10db6641"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:47.892051 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-4ce4e8a0-5637-4f3c-8c38-2f63550f972d req-6203175f-dbc1-4a80-b136-c325c1c7212c service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:47.892863 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-4ce4e8a0-5637-4f3c-8c38-2f63550f972d req-6203175f-dbc1-4a80-b136-c325c1c7212c service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:47.893513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-4ce4e8a0-5637-4f3c-8c38-2f63550f972d req-6203175f-dbc1-4a80-b136-c325c1c7212c service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:47.909222 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-4ce4e8a0-5637-4f3c-8c38-2f63550f972d req-6203175f-dbc1-4a80-b136-c325c1c7212c service nova] Creating event network-changed:ea460abd-9103-4311-9677-c18e10db6641 for instance e652ad27-aa55-41e5-ba8e-5110c204c128 on hv-cinder-85032 Aug 23 16:39:47.917404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-4ce4e8a0-5637-4f3c-8c38-2f63550f972d req-6203175f-dbc1-4a80-b136-c325c1c7212c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040480 Aug 23 16:39:47.918851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 96/203] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:39:47.942552 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lazy-loading 'flavor' on Instance uuid bf88c183-6ffb-49b3-88b4-1813e0e5aeec {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:39:48.271747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:48.272875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:48.280492 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:48.281363 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:48.282004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:48.285881 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:48.285881 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:48.285881 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:48.421876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-27eac0c4-0b93-4bea-be7d-cad292d5f3ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec/action" status: 200 len: 32 microversion: 2.1 time: 0.567346 Aug 23 16:39:48.422558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 108/204] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:39:47 2022] POST /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec/action => generated 32 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 16:39:48.428355 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:48.429541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:48.436796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:48.437211 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:48.437735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:48.438369 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:48.439263 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:48.439896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:48.440524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:48.447200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-96d8f765-ea1a-4183-94a3-9c6e727366b3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.180012 Aug 23 16:39:48.460284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 97/205] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:48 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:48.722548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:48.736677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8e11bb09-47ff-4a1c-ad77-ceb20b50b860 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.311744 Aug 23 16:39:48.739283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 109/206] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:48 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:49.473473 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:49.474071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:49.480451 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:49.481000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:49.481366 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:49.482051 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:49.482525 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:49.482947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:49.614107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:49.621749 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2c118598-ecc0-4d6d-9148-0d06c3304b5f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.152133 Aug 23 16:39:49.622322 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 98/207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:49 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:49.758853 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:49.759506 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:49.765514 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:49.765987 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:49.766419 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:49.767098 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:49.767543 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:49.767959 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:49.915105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:49.915105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1dffffb3-a1f2-4ad5-8418-2176d5788145 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.158389 Aug 23 16:39:49.915105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 110/208] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:49 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:50.643629 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:50.644262 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:50.650362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:50.650846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:50.651282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:50.651970 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:50.652455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:50.652882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:50.789418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:50.797164 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-31ca487e-47a3-4075-b7a4-42d50f227bc1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.157518 Aug 23 16:39:50.797742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 99/209] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:50 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:50.934616 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:50.935700 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:50.941802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:50.942291 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:50.942734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:50.943423 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:50.943878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:50.944333 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:51.077395 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:51.085032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-96d85e12-cafc-4cde-b94b-00ac88a142d7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.154414 Aug 23 16:39:51.085598 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 111/210] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:50 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:51.817922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:51.818528 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:51.824428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:51.824911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:51.825342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:51.826029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:51.826477 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:51.827456 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:51.964077 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:51.972450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-00ad5574-d5db-4045-8021-30cbc99389c4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.158260 Aug 23 16:39:51.973031 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 100/211] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:51 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:52.106259 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:52.106916 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:52.113060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:52.113549 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:52.113989 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:52.114675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:52.115131 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:52.115559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:52.249263 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:52.256827 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-580690ce-71c1-4c0d-9dbf-327aea04e73b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.154501 Aug 23 16:39:52.257402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 112/212] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:52 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:52.993923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:52.994546 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:53.001039 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:53.001525 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:53.001957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:53.002652 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:53.003100 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:53.003519 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:53.138169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:53.146236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2936bbc8-780e-4e35-8b42-89228ff06a2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.156494 Aug 23 16:39:53.147332 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 101/213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:52 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:53.277718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:53.278341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:53.285380 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:53.285872 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:53.286314 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:53.287013 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:53.287471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:53.287896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:53.433654 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:53.439925 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-015d4664-af11-44e1-910a-207a924bda3f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.166117 Aug 23 16:39:53.440541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 113/214] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:53 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:54.060726 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4f7d1780-2dbf-45fb-8c22-3dfe3622a25f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e33d3b85-51e5-413a-9a51-7c0f03e492ee"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:54.069152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4f7d1780-2dbf-45fb-8c22-3dfe3622a25f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:54.082091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f7d1780-2dbf-45fb-8c22-3dfe3622a25f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:54.082091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f7d1780-2dbf-45fb-8c22-3dfe3622a25f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:54.082091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f7d1780-2dbf-45fb-8c22-3dfe3622a25f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:54.082091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f7d1780-2dbf-45fb-8c22-3dfe3622a25f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:54.082381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f7d1780-2dbf-45fb-8c22-3dfe3622a25f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:54.082381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f7d1780-2dbf-45fb-8c22-3dfe3622a25f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:54.173262 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:54.174214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:54.180638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:54.181120 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:54.181556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:54.182244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:54.182692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:54.183108 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:54.202277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:54.319317 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:54.328180 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5c3f60b7-79a3-410e-b5b7-c44e25e26322 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.161033 Aug 23 16:39:54.328758 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 114/215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:54 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:54.466830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:54.468004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:54.476125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:54.476727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:54.477590 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:54.478303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:54.479178 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:54.479768 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:54.669477 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:54.686417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-94070f1d-e2fb-4260-9397-293035a65de9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.225516 Aug 23 16:39:54.688135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 115/216] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:54 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:55.258789 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4f7d1780-2dbf-45fb-8c22-3dfe3622a25f tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "POST /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.201948 Aug 23 16:39:55.259607 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 102/217] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:39:54 2022] POST /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69/os-volume_attachments => generated 194 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:55.349584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:55.350214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:55.356591 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:55.357074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:55.357619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:55.358376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:55.358829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:55.359448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:55.499856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:55.508102 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cf26d20d-c7b1-47e7-9c6d-0bc6d0b4333b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1364 microversion: 2.1 time: 0.162893 Aug 23 16:39:55.508699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 116/218] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:55 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:55.711411 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:55.712059 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:55.718951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:55.719433 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:55.719869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:55.726141 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:55.726141 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:55.726141 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:55.867860 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:55.874737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3d486faa-4230-4154-a882-1d00fe85903a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.166569 Aug 23 16:39:55.883217 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 103/219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:55 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:56.529019 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:56.529664 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:56.535700 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:56.536224 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:56.536667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:56.537358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:56.537809 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:56.538230 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:56.678870 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:56.686723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-daaa215e-a8c6-42d8-960e-b3ac67c1ddad tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1550 microversion: 2.1 time: 0.161666 Aug 23 16:39:56.687211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 117/220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:56 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:39:56.707501 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7421e44c-c7bd-452b-8555-6269a62b430f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:56.708024 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7421e44c-c7bd-452b-8555-6269a62b430f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:56.714068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7421e44c-c7bd-452b-8555-6269a62b430f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:56.714550 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7421e44c-c7bd-452b-8555-6269a62b430f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:56.714971 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7421e44c-c7bd-452b-8555-6269a62b430f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:56.715678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7421e44c-c7bd-452b-8555-6269a62b430f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:56.716121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7421e44c-c7bd-452b-8555-6269a62b430f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:56.716577 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7421e44c-c7bd-452b-8555-6269a62b430f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:56.794592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7421e44c-c7bd-452b-8555-6269a62b430f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090976 Aug 23 16:39:56.795092 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 104/221] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 23 16:39:56 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:39:56.895483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:56.896100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:56.902076 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:56.902564 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:56.902994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:56.903885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:56.904368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:56.905453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:57.176965 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:57.185458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-51c87bfb-1014-49ed-b51b-4193b3a43f3b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.293723 Aug 23 16:39:57.186367 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 118/222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:56 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:58.210840 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:58.211427 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:58.218984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:58.219628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:58.220409 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:58.226699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:58.226699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:58.226699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:58.462164 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:58.463856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-98fb3434-6995-4624-a808-c3a2d6ae3825 req-dd1129d3-f6a7-40b8-a77e-385e102fddc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abfc7760-8432-47e6-b2a3-b4052a52201f", "tag": "e562daf2-33d4-4bb1-8e1b-b8386367dab6"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:39:58.477641 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-025613bf-e128-4ce6-b836-75b29d74dbad tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.271395 Aug 23 16:39:58.478241 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 105/223] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:58 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:39:58.483200 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-98fb3434-6995-4624-a808-c3a2d6ae3825 req-dd1129d3-f6a7-40b8-a77e-385e102fddc4 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:58.486357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-98fb3434-6995-4624-a808-c3a2d6ae3825 req-dd1129d3-f6a7-40b8-a77e-385e102fddc4 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:58.486357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-98fb3434-6995-4624-a808-c3a2d6ae3825 req-dd1129d3-f6a7-40b8-a77e-385e102fddc4 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:58.499015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-98fb3434-6995-4624-a808-c3a2d6ae3825 req-dd1129d3-f6a7-40b8-a77e-385e102fddc4 service nova] Creating event network-changed:e562daf2-33d4-4bb1-8e1b-b8386367dab6 for instance abfc7760-8432-47e6-b2a3-b4052a52201f on hv-cinder-85032 Aug 23 16:39:58.504618 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-98fb3434-6995-4624-a808-c3a2d6ae3825 req-dd1129d3-f6a7-40b8-a77e-385e102fddc4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045241 Aug 23 16:39:58.505718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 119/224] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:39:59.499801 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:39:59.500444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:39:59.507526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:59.508014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:59.508486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:59.509708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:39:59.510229 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:39:59.510656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:39:59.515000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:39:59.669690 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:39:59.678766 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0d70bc2f-da4b-46f0-883f-9d091574c96a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.183523 Aug 23 16:39:59.679356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 106/225] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:39:59 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:00.699449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:00.700146 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:00.707204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:00.707665 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:00.708101 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:00.708839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:00.709291 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:00.709715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:00.862170 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:00.869780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fd3b2c40-990d-4a36-a51b-fadadda37c81 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.174489 Aug 23 16:40:00.870481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 120/226] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:00 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:01.891560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:01.892719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:01.913666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:01.913666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:01.913666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:01.913666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:01.913942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:01.913942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:02.042314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:02.049679 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4f0a2485-0024-444a-a71f-63ff3f04c27f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.162329 Aug 23 16:40:02.050249 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 107/227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:01 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:03.071105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:03.071743 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:03.077621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:03.078103 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:03.078535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:03.080320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:03.080786 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:03.081221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:03.218174 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:03.228112 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e5da57b3-a837-4c42-973e-4b9771e7ed0e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.160762 Aug 23 16:40:03.235124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 121/228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:03 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:04.249352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:04.249965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:04.257219 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:04.257755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:04.258186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:04.258875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:04.259330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:04.259809 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:04.401271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:04.407067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-fc07233d-fa27-43a7-9972-d7ef8ebf0e99 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.161519 Aug 23 16:40:04.408301 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 108/229] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:04 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:05.430313 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:05.430313 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:05.435575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:05.436056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:05.436558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:05.437228 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:05.437685 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:05.438132 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:05.571833 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:05.580579 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bc6e1b54-e9e3-4475-b3e3-92ba267ac063 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.155816 Aug 23 16:40:05.581158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 122/230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:05 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:06.601836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:06.602671 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:06.609252 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:06.609741 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:06.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:06.610871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:06.611323 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:06.612364 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:06.773949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:06.785751 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b3fbcf98-5467-41a9-866d-5bddbec97f57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.187413 Aug 23 16:40:06.804439 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 109/231] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:06 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:07.806856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:07.807835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:07.813520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:07.813998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:07.814442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:07.815684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:07.818580 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:07.818580 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:07.979244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:07.987269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3477fbda-42ab-40fc-8007-cbbd396bd985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.184353 Aug 23 16:40:07.987847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 123/232] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:07 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:09.009436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:09.009846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:09.016446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:09.017150 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:09.017585 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:09.019327 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:09.019931 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:09.020916 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:09.188703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:09.196684 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bd96f181-4baa-48a7-b5b7-09152d88bd86 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.191437 Aug 23 16:40:09.197267 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 110/233] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:09 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:10.218734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:10.219619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:10.226521 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:10.227004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:10.227483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:10.228224 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:10.228684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:10.229301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:10.370760 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:10.378545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-84a08562-c0a6-467d-85c0-d578a22bba6f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.163717 Aug 23 16:40:10.379104 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 124/234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:10 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:11.399261 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:11.399764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:11.402791 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=58 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:11.407723 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:11.409944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:11.409944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:11.409944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:11.410189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:11.410444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:11.613648 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:11.636932 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6d3ab288-d854-44e8-95a9-8095d036a707 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.241339 Aug 23 16:40:11.639212 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 111/235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:11 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:12.658454 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:12.660086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:12.665325 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=58 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:12.666703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:12.667354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:12.667976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:12.668746 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:12.673358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:12.673819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:12.822490 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:12.834475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a66af216-0d7e-460c-9a6a-684fd42e55d3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.179834 Aug 23 16:40:12.835076 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 125/236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:12 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:13.858100 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:13.859937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:13.872012 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:13.872975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:13.873586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:13.874456 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:13.875063 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:13.875638 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:14.031581 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:14.039413 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2bec7e95-7dbb-462d-9d0c-2cdf915e36cf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.187474 Aug 23 16:40:14.040025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 112/237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:13 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:14.684485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:14.685033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:14.691679 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:14.692192 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:14.692644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:14.693337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:14.693795 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:14.694224 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:14.725012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Going to try to terminate instance {{(pid=133198) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:40:15.061340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:15.062672 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:15.069890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:15.070329 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:15.070755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:15.071722 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:15.072191 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:15.072612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:15.203048 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:15.203226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9744a894-8b34-4214-a467-f434193f04ed tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 204 len: 0 microversion: 2.1 time: 0.522254 Aug 23 16:40:15.207662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 126/238] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:40:14 2022] DELETE /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:40:15.214677 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3da079ff-8564-488e-aac3-5650ab3d73f1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.158632 Aug 23 16:40:15.217369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 113/239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:15 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:15.218037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:15.218806 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:15.225787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:15.226530 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:15.226968 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:15.227676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:15.228411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:15.229041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:15.364353 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:15.373107 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9910c11b-2c05-4b92-bc54-4145209100ec tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1553 microversion: 2.1 time: 0.160861 Aug 23 16:40:15.373679 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 127/240] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:15 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:15.985078 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1672314116", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "networks": [{"uuid": "2d94ba77-c4a8-4d03-ba1e-b200b082d8f9"}]}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:16.038991 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] validate_networks() for [('2d94ba77-c4a8-4d03-ba1e-b200b082d8f9', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:40:16.242555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:16.244334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:16.252779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:16.253415 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:16.253851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:16.254568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:16.255025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:16.255618 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:16.469184 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:40:16.469891 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:40:16.470690 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:40:16.471953 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:40:16.472673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:40:16.476532 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:16.488805 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:16.489282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:16.489704 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:16.490414 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:16.490858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:16.491270 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:16.492861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-14d3d393-4555-4aa6-a4f9-410b0901218e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.256662 Aug 23 16:40:16.506643 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 128/241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:16 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:16.511134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Getting quotas for project 607930a9b6ea4abaa9783f197824331a. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:40:16.514250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:16.514250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:16.516006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Getting quotas for user 36f919a0881e47b893bf2cad5367ed58 and project 607930a9b6ea4abaa9783f197824331a. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:40:16.522408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:16.523029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:16.523580 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:16.524527 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:16.525197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:16.525775 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:16.528692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:40:16.530897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:40:16.662544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7e742927-b98a-4597-b50e-cdb11525b1d7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681296 Aug 23 16:40:16.663238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 114/242] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:40:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:40:16.664887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:16.675150 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4ee7cce3-495e-4a46-949c-877aa7c14c02 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:16.675764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4ee7cce3-495e-4a46-949c-877aa7c14c02 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:16.677932 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6f19e4ee-6bf4-4826-9a0f-f2340941f4ab tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1553 microversion: 2.1 time: 0.170002 Aug 23 16:40:16.680758 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 129/243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:16 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:16.763586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4ee7cce3-495e-4a46-949c-877aa7c14c02 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:16.772142 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4ee7cce3-495e-4a46-949c-877aa7c14c02 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1219 microversion: 2.1 time: 0.101126 Aug 23 16:40:16.772957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 115/244] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:16 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:17.522893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:17.523543 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:17.529551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:17.530036 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:17.530475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:17.531168 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:17.531624 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:17.532053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:17.537051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:17.701050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:17.701656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:17.705442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:17.714594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:17.714594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:17.714594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:17.714594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:17.715485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:17.715485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:17.715739 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5307270b-65af-4b2c-9164-48c72247a026 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.195635 Aug 23 16:40:17.715739 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 130/245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:17 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:17.794012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-61281e49-99af-4e96-9626-c4c1b6810624 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:17.794924 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-61281e49-99af-4e96-9626-c4c1b6810624 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:17.861245 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-61281e49-99af-4e96-9626-c4c1b6810624 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:17.870971 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-61281e49-99af-4e96-9626-c4c1b6810624 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1219 microversion: 2.1 time: 0.080768 Aug 23 16:40:17.874759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 131/246] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:17 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:17.907477 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:17.916947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6b2136cf-7139-4996-95bf-edf5611edea9 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1553 microversion: 2.1 time: 0.219794 Aug 23 16:40:17.922061 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 116/247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:17 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:18.740195 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:18.740195 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:18.745612 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:18.746281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:18.746884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:18.747726 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:18.748359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:18.748779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:18.895948 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:18.898506 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:18.899263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:18.906124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:18.906579 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7ffa407f-1a91-4c7f-8672-e9a1c6165607 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.172332 Aug 23 16:40:18.906793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:18.907177 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 132/248] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:18 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:18.907689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:18.908851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:18.909416 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:18.914536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:18.939448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:18.940731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:18.959277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:18.969621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:18.970214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:18.971559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:18.972488 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:18.973361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:18.986968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:18.995374 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2d27f164-cd3e-4c40-9f91-79286e368445 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1223 microversion: 2.1 time: 0.106016 Aug 23 16:40:18.996084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 117/249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:18 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:19.118993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:19.127031 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a10fe1a7-97ab-40b5-879d-3c8d2d5ce004 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1553 microversion: 2.1 time: 0.192358 Aug 23 16:40:19.127709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 133/250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:18 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:19.933721 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:19.934369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:19.943838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:19.943838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:19.943838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:19.943838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:19.944143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:19.944143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:20.021053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:20.022274 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:20.030145 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:20.030871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:20.031436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:20.032408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:20.032940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:20.033433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:20.129209 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:20.135817 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:20.137946 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a8226589-d99d-42a9-902c-aba5928ffe0b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1223 microversion: 2.1 time: 0.123941 Aug 23 16:40:20.143338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 134/251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:20 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:20.146603 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3c446235-4a54-4c71-96ab-12da9e4f9141 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.216861 Aug 23 16:40:20.147584 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 118/252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:19 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:20.157745 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:20.158458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:20.165221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:20.166709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:20.166709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:20.166924 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:20.167358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:20.167792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:20.306671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:20.315744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5c52877a-0212-4595-8d4d-44a0d1a7701b tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1553 microversion: 2.1 time: 0.161860 Aug 23 16:40:20.316348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 135/253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:20 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:21.160452 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:21.161181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:21.167852 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:21.168450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:21.168887 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:21.169143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:21.170068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:21.170215 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:21.170338 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:21.170447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:21.175975 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:21.176498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:21.176941 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:21.177674 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:21.178302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:21.178734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:21.240146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:21.248574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-34d7e01e-a0ff-4dc1-8969-9a7b102d9f1a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1223 microversion: 2.1 time: 0.092633 Aug 23 16:40:21.253041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 119/254] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:21 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:21.340572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:21.340572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1b21ef8e-c041-4f1a-a111-39b2ad706704 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.169492 Aug 23 16:40:21.340572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 136/255] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:21 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:21.340791 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:21.340791 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:21.344365 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:21.344850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:21.345277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:21.345969 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:21.346416 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:21.346838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:21.482434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:21.487961 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5911b1df-2abf-479d-8d4d-a8c5fc9a4c16 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1553 microversion: 2.1 time: 0.154410 Aug 23 16:40:21.488572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 120/256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:21 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:22.222218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-df3e9e4e-f4d6-45c1-89fa-8f0ab6175c7b req-aa2aae2b-50eb-4a34-aa7c-c3447a7a3a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c4b544-8888-42a5-9d5e-2add07e40c69", "name": "network-vif-unplugged", "status": "completed", "tag": "957d3383-6848-4d1d-8aca-dbef211d2c23"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:22.235198 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-df3e9e4e-f4d6-45c1-89fa-8f0ab6175c7b req-aa2aae2b-50eb-4a34-aa7c-c3447a7a3a8a service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:22.235680 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-df3e9e4e-f4d6-45c1-89fa-8f0ab6175c7b req-aa2aae2b-50eb-4a34-aa7c-c3447a7a3a8a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:22.236116 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-df3e9e4e-f4d6-45c1-89fa-8f0ab6175c7b req-aa2aae2b-50eb-4a34-aa7c-c3447a7a3a8a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:22.248043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-df3e9e4e-f4d6-45c1-89fa-8f0ab6175c7b req-aa2aae2b-50eb-4a34-aa7c-c3447a7a3a8a service nova] Creating event network-vif-unplugged:957d3383-6848-4d1d-8aca-dbef211d2c23 for instance a9c4b544-8888-42a5-9d5e-2add07e40c69 on hv-cinder-85032 Aug 23 16:40:22.253205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-df3e9e4e-f4d6-45c1-89fa-8f0ab6175c7b req-aa2aae2b-50eb-4a34-aa7c-c3447a7a3a8a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037868 Aug 23 16:40:22.253824 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 137/257] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:40:22.269869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:22.271057 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:22.277505 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:22.277990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:22.278422 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:22.279117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:22.279580 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:22.280005 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:22.351645 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:22.359475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:22.360198 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ec043dfa-4ea4-40ad-9cad-173435a8ce4a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1223 microversion: 2.1 time: 0.094042 Aug 23 16:40:22.360681 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:22.363317 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 121/258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:22 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:22.368683 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:22.369365 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:22.370006 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:22.370912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:22.371507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:22.372119 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:22.509443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:22.510699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:22.518510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:22.519346 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:22.519785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:22.521034 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:22.521523 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:22.522113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:22.525456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:22.536564 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0a46c7d3-22da-4f67-855f-ea682ab0455f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.182036 Aug 23 16:40:22.545786 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 138/259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:22 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:22.669796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:22.679019 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3682ea94-8c08-4645-97da-6ac4af2107ce tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1553 microversion: 2.1 time: 0.173697 Aug 23 16:40:22.679789 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 122/260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:22 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:23.161417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-7c7d84c0-95bf-4ec9-9f14-303ceef25d7f req-2a7121a8-f62e-43d1-a09b-6213d69b10ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9c4b544-8888-42a5-9d5e-2add07e40c69", "name": "network-vif-deleted", "tag": "957d3383-6848-4d1d-8aca-dbef211d2c23"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:23.171027 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-7c7d84c0-95bf-4ec9-9f14-303ceef25d7f req-2a7121a8-f62e-43d1-a09b-6213d69b10ba service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:23.171535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-7c7d84c0-95bf-4ec9-9f14-303ceef25d7f req-2a7121a8-f62e-43d1-a09b-6213d69b10ba service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:23.172001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-7c7d84c0-95bf-4ec9-9f14-303ceef25d7f req-2a7121a8-f62e-43d1-a09b-6213d69b10ba service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:23.184203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-7c7d84c0-95bf-4ec9-9f14-303ceef25d7f req-2a7121a8-f62e-43d1-a09b-6213d69b10ba service nova] Creating event network-vif-deleted:957d3383-6848-4d1d-8aca-dbef211d2c23 for instance a9c4b544-8888-42a5-9d5e-2add07e40c69 on hv-cinder-85032 Aug 23 16:40:23.189454 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-7c7d84c0-95bf-4ec9-9f14-303ceef25d7f req-2a7121a8-f62e-43d1-a09b-6213d69b10ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031736 Aug 23 16:40:23.190812 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 139/261] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:40:23.382043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:23.382558 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:23.389079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:23.392465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:23.392465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:23.392465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:23.392465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:23.393315 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:23.457779 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:23.468995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7d5f04fd-6550-411c-a5be-f35e2911e1ca tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1271 microversion: 2.1 time: 0.087648 Aug 23 16:40:23.468995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 123/262] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:23 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:23.559243 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:23.560107 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:23.567162 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:23.567671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:23.574541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:23.574541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:23.574541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:23.574541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:23.703085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:23.704307 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:23.720116 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:23.723280 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:23.724834 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:23.727037 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:23.727507 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:23.734902 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:23.785224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:23.800881 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:23.805675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-852b3284-95f3-4cea-975a-4190e900cbdd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.250957 Aug 23 16:40:23.808225 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 140/263] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:23 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:23.851736 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:23.860228 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-71d648d6-4e45-461b-8093-273039bff81a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1346 microversion: 2.1 time: 0.163984 Aug 23 16:40:23.861378 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 124/264] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:23 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:24.134817 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1764541990", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:24.194478 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] validate_networks() for None {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:40:24.491517 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:24.492390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:24.499512 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:24.499994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:24.500451 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:24.501155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:24.501755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:24.502190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:24.775278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:40:24.778748 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:24.782914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:40:24.783037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:40:24.784036 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:40:24.784479 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:40:24.787774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b714ce2e-332a-48c8-adb0-1ab39e23ae11 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.300834 Aug 23 16:40:24.788421 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 125/265] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:24 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:24.796151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:24.796698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:24.797142 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:24.797866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:24.798320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:24.798745 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:24.816307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Getting quotas for project 4ebc216b3b834c64b9050e5be8ca1154. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:40:24.820493 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Getting quotas for user 71044fadc41c4a78837c5cfeefb5b858 and project 4ebc216b3b834c64b9050e5be8ca1154. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:40:24.829598 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:24.830969 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:24.833086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:40:24.835446 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:40:24.837202 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:24.840285 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:24.840285 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:24.840285 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:24.840285 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:24.840602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:24.979054 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:24.989460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9c6dea38-d4c6-4a90-82cd-efdff8382baf tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.163527 Aug 23 16:40:24.990544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 126/266] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:24 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:25.003004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:25.003924 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:25.012344 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:25.012942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:25.013448 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:25.014287 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:25.014796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:25.015279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:25.022051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-58a6705c-5c05-4f9e-a52a-83ec3c566d34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889729 Aug 23 16:40:25.022910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 141/267] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:40:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:40:25.052462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-52f3f7c1-3bc3-4ec8-8fcc-eec3a692f306 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:25.053727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-52f3f7c1-3bc3-4ec8-8fcc-eec3a692f306 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:25.055574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:25.055775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:25.056237 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:25.056785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lazy-loading 'fault' on Instance uuid a9c4b544-8888-42a5-9d5e-2add07e40c69 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:40:25.123260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd387030ec72f4807869e721db76e490e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c44875761174fa092919342baf9022d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:25.141278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0246ac45-8df0-4d87-956b-66d7f3e27d28 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 200 len: 1351 microversion: 2.1 time: 0.149482 Aug 23 16:40:25.141873 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 127/268] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:24 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 1351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:25.148585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-52f3f7c1-3bc3-4ec8-8fcc-eec3a692f306 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:25.155793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-52f3f7c1-3bc3-4ec8-8fcc-eec3a692f306 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1215 microversion: 2.1 time: 0.125890 Aug 23 16:40:25.156407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 142/269] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:25 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:25.809142 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-e61b901c-35c1-44e4-bb17-dd5f8d3e240b req-7fd16d0e-7867-4c08-bdec-43e711d45a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ce2e0d-564c-4b98-b0a5-416658f5968b", "tag": "5cdbf042-8797-4daf-8e46-c209712ca749"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:25.809950 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:25.811054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:25.820092 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:25.820888 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:25.821433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:25.821574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-e61b901c-35c1-44e4-bb17-dd5f8d3e240b req-7fd16d0e-7867-4c08-bdec-43e711d45a6d service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:25.821978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-e61b901c-35c1-44e4-bb17-dd5f8d3e240b req-7fd16d0e-7867-4c08-bdec-43e711d45a6d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:25.822445 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:25.822945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-e61b901c-35c1-44e4-bb17-dd5f8d3e240b req-7fd16d0e-7867-4c08-bdec-43e711d45a6d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:25.823207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:25.823730 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:25.835291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-e61b901c-35c1-44e4-bb17-dd5f8d3e240b req-7fd16d0e-7867-4c08-bdec-43e711d45a6d service nova] Creating event network-changed:5cdbf042-8797-4daf-8e46-c209712ca749 for instance d1ce2e0d-564c-4b98-b0a5-416658f5968b on hv-cinder-85032 Aug 23 16:40:25.840722 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-e61b901c-35c1-44e4-bb17-dd5f8d3e240b req-7fd16d0e-7867-4c08-bdec-43e711d45a6d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035427 Aug 23 16:40:25.841719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 128/270] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:40:25.961715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:25.969567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a5d295f6-1930-4225-b554-f6839de19377 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.163843 Aug 23 16:40:25.970146 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 143/271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:25 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:26.013349 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:26.013958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:26.020695 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:26.021180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:26.021601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:26.022290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:26.022743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:26.023155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:26.163350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:26.167582 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:26.168286 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:26.175910 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a72cd5c0-c3bb-4703-92ae-81420556f1ba tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.166737 Aug 23 16:40:26.176487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:26.177008 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 129/272] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:26 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:26.177376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:26.178046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:26.179048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:26.179693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:26.180349 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:26.182637 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5f0d02d7-6b08-4338-aa4b-b9accdb39e41 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:26.183320 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5f0d02d7-6b08-4338-aa4b-b9accdb39e41 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:26.198293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] HTTP exception thrown: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Request method failure captured: Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 HTTP/1.1 Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKV1DYuF9yxbDRRbB69MKOJy0xQkcZMbzOqihKCJxJ4vbrnKFelCmxyY6asUe1j5ITmGw0tGZlwTJRJpObpnMe_XaKmo1w_2WIBWuhNf7z5S--ZggEboE9RGP7NnSPIqQhT_Ej_VaKazAcAcUsO28b1FZa4g2l_7ynip9-N0StdthE Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 0c44875761174fa092919342baf9022d Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:40:26.203054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c44875761174fa092919342baf9022d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c44875761174fa092919342baf9022d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c44875761174fa092919342baf9022d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c44875761174fa092919342baf9022d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 0c44875761174fa092919342baf9022d Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-DeleteServersTestJSON-724041910-project Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: d387030ec72f4807869e721db76e490e Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-DeleteServersTestJSON-724041910-project Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.204440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'a9c4b544-8888-42a5-9d5e-2add07e40c69'} Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:40:26.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.206354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.207344 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Returning 404 to user: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:40:26.207344 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2abcf70b-e95b-43c2-8ebc-6576786c0cef tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 404 len: 111 microversion: 2.1 time: 0.041236 Aug 23 16:40:26.207344 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 144/273] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:26 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:40:26.252710 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5f0d02d7-6b08-4338-aa4b-b9accdb39e41 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:26.261444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5f0d02d7-6b08-4338-aa4b-b9accdb39e41 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1215 microversion: 2.1 time: 0.083196 Aug 23 16:40:26.262040 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 130/274] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:26 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:26.335852 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:26.338175 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:26.344326 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:26.344816 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:26.346516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:26.346516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:26.346516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:26.346844 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:26.360303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] HTTP exception thrown: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Request method failure captured: Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69/os-volume_attachments HTTP/1.1 Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKV1DYuF9yxbDRRbB69MKOJy0xQkcZMbzOqihKCJxJ4vbrnKFelCmxyY6asUe1j5ITmGw0tGZlwTJRJpObpnMe_XaKmo1w_2WIBWuhNf7z5S--ZggEboE9RGP7NnSPIqQhT_Ej_VaKazAcAcUsO28b1FZa4g2l_7ynip9-N0StdthE Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 0c44875761174fa092919342baf9022d Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:40:26.362408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c44875761174fa092919342baf9022d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c44875761174fa092919342baf9022d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c44875761174fa092919342baf9022d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c44875761174fa092919342baf9022d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 0c44875761174fa092919342baf9022d Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-DeleteServersTestJSON-724041910-project Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: d387030ec72f4807869e721db76e490e Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-DeleteServersTestJSON-724041910-project Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.363960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'server_id': 'a9c4b544-8888-42a5-9d5e-2add07e40c69'} Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:40:26.364773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:26.365996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:26.367306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Returning 404 to user: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:40:26.367306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2a3de93e-f7ec-445f-9212-c6c7d1ea2594 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032056 Aug 23 16:40:26.367306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 145/275] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:40:26 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:40:26.999088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:26.999732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:27.001732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:27.007026 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.007506 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.007941 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.008654 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.009108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.009683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.145694 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:27.153995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-55f4f30f-39db-44ff-9a2e-a05642f06079 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.158911 Aug 23 16:40:27.154571 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 131/276] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:26 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:27.198492 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:27.199278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:27.205915 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.206403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.206843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.207543 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.207999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.208465 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.232560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1278279912", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "networks": [{"uuid": "9dfacecf-9308-4f0e-92e3-c466f669021e"}]}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:27.288819 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] validate_networks() for [('9dfacecf-9308-4f0e-92e3-c466f669021e', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:40:27.429147 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:27.437174 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1a44f44f-dd4e-484d-8a2b-1df764e3fa96 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.242526 Aug 23 16:40:27.437745 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 146/277] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:27 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:27.442755 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:27.443359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:27.449069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.449542 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.449978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.450671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.451116 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.451749 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.538363 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:27.546181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b0820db4-636a-4833-ae47-db81308870a5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1211 microversion: 2.1 time: 0.107461 Aug 23 16:40:27.546749 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 147/278] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:27 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:27.711560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:40:27.711984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:40:27.712532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:40:27.712950 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:40:27.713758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:40:27.722434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.722937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.723465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.724105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.724572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.725023 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.742602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Getting quotas for project e4b82742e5d94428b3397db5e6b6dfd3. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:40:27.746473 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Getting quotas for user b8a23dda6cf24ee6a6c73cd1d6189dca and project e4b82742e5d94428b3397db5e6b6dfd3. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:40:27.758110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:40:27.760520 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:40:27.887173 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:27.887677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:27.893735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.894477 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.894722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.895420 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.895876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.896344 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.900813 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-275b4d20-0160-411c-9aa0-ee5abb51544e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672091 Aug 23 16:40:27.901651 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 132/279] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 16:40:27.912050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-971007b1-502c-4f57-ba0c-660346e81021 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:27.915329 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-971007b1-502c-4f57-ba0c-660346e81021 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:27.919585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] HTTP exception thrown: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Request method failure captured: Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: DELETE /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 HTTP/1.1 Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKV1DYuF9yxbDRRbB69MKOJy0xQkcZMbzOqihKCJxJ4vbrnKFelCmxyY6asUe1j5ITmGw0tGZlwTJRJpObpnMe_XaKmo1w_2WIBWuhNf7z5S--ZggEboE9RGP7NnSPIqQhT_Ej_VaKazAcAcUsO28b1FZa4g2l_7ynip9-N0StdthE Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 0c44875761174fa092919342baf9022d Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:40:27.926412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c44875761174fa092919342baf9022d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c44875761174fa092919342baf9022d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c44875761174fa092919342baf9022d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c44875761174fa092919342baf9022d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 0c44875761174fa092919342baf9022d Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-DeleteServersTestJSON-724041910-project Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: d387030ec72f4807869e721db76e490e Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-DeleteServersTestJSON-724041910-project Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.927545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'a9c4b544-8888-42a5-9d5e-2add07e40c69'} Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:40:27.928461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.934876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.936561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Returning 404 to user: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:40:27.936561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bfcab611-888f-4aaf-9dd6-7392209192e3 tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 404 len: 111 microversion: 2.1 time: 0.044577 Aug 23 16:40:27.936561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 148/280] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:40:27 2022] DELETE /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 16:40:27.941805 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:27.942656 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] [instance: a9c4b544-8888-42a5-9d5e-2add07e40c69] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:27.950201 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.950776 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.951293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.952134 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:27.952851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:27.953356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:27.969157 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] HTTP exception thrown: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Request method failure captured: Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 HTTP/1.1 Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKV1DYuF9yxbDRRbB69MKOJy0xQkcZMbzOqihKCJxJ4vbrnKFelCmxyY6asUe1j5ITmGw0tGZlwTJRJpObpnMe_XaKmo1w_2WIBWuhNf7z5S--ZggEboE9RGP7NnSPIqQhT_Ej_VaKazAcAcUsO28b1FZa4g2l_7ynip9-N0StdthE Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 0c44875761174fa092919342baf9022d Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:40:27.970759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c44875761174fa092919342baf9022d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0c44875761174fa092919342baf9022d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0c44875761174fa092919342baf9022d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0c44875761174fa092919342baf9022d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 0c44875761174fa092919342baf9022d Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-DeleteServersTestJSON-724041910 Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-DeleteServersTestJSON-724041910-project Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: d387030ec72f4807869e721db76e490e Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-DeleteServersTestJSON-724041910-project Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.972231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'a9c4b544-8888-42a5-9d5e-2add07e40c69'} Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:40:27.973053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. Aug 23 16:40:27.974397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:40:27.975450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] Returning 404 to user: Instance a9c4b544-8888-42a5-9d5e-2add07e40c69 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:40:27.975450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9e89ac52-774c-4a39-a55e-9e6118f2b92a tempest-DeleteServersTestJSON-724041910 tempest-DeleteServersTestJSON-724041910-project] 10.222.0.52 "GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69" status: 404 len: 111 microversion: 2.1 time: 0.038013 Aug 23 16:40:27.975450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 149/281] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:27 2022] GET /compute/v2.1/servers/a9c4b544-8888-42a5-9d5e-2add07e40c69 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:40:27.994590 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-971007b1-502c-4f57-ba0c-660346e81021 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:28.005538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-971007b1-502c-4f57-ba0c-660346e81021 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1214 microversion: 2.1 time: 0.097234 Aug 23 16:40:28.006428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 133/282] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:27 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:28.176582 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:28.177211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:28.183145 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:28.184097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:28.184591 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:28.185294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:28.185752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:28.186179 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:28.461245 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:28.462417 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:28.470106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:28.470724 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:28.472355 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:28.473277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:28.473896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:28.474327 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:28.500802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:28.510444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8f76be50-9646-4507-be1e-54ee8d8f1d38 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.338253 Aug 23 16:40:28.511781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 150/283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:28 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:28.574374 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:28.574986 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:28.583008 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:28.583500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:28.583934 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:28.584667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:28.585115 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:28.585540 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:28.625585 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:28.634169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0b22451e-2aa1-4d50-a361-57b91f73c914 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.177774 Aug 23 16:40:28.634745 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 134/284] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:28 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:28.675976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:28.684612 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7dc7c406-d795-4d79-8a35-da471ab52235 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1211 microversion: 2.1 time: 0.114397 Aug 23 16:40:28.685252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 151/285] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:28 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1211 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:29.026178 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-784cc27f-6a95-4630-aefc-618e01f0a3fa tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:29.026710 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-784cc27f-6a95-4630-aefc-618e01f0a3fa tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:29.094009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-784cc27f-6a95-4630-aefc-618e01f0a3fa tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:29.102421 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-784cc27f-6a95-4630-aefc-618e01f0a3fa tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1214 microversion: 2.1 time: 0.080180 Aug 23 16:40:29.103223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 135/286] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:29 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:29.534418 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:29.535721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:29.542271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:29.542866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:29.543407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:29.544265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:29.544924 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:29.545546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:29.668514 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:29.669233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:29.682281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:29.685023 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:29.685814 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:29.686743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:29.687637 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:29.688472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:29.717213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:29.727568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b4377393-938f-4425-9623-229732d1ea43 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.198609 Aug 23 16:40:29.744557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 152/287] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:29 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:29.750141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:29.750753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:29.757647 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:29.762495 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:29.762949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:29.764337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:29.764933 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:29.771124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:29.784974 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:29.850610 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:29.862723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a2dccdfc-6f5b-4081-be32-7e7631050f82 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1211 microversion: 2.1 time: 0.116701 Aug 23 16:40:29.863394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 153/288] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:29 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:29.884187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:29.893698 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d6e1e508-ee80-4b4e-b3af-96e0b11a068f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.240437 Aug 23 16:40:29.894210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 136/289] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:29 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:30.123000 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:30.124103 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:30.133005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:30.133722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:30.135475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:30.136783 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:30.138345 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:30.138937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:30.242597 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:30.250541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0a441cba-c0d8-436e-9ccf-e635c820d808 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1218 microversion: 2.1 time: 0.131523 Aug 23 16:40:30.251120 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 154/290] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:30 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:30.753878 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:30.755269 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:30.762490 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:30.763390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:30.764254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:30.764778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:30.765295 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:30.765913 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:30.883792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:30.885021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:30.894088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:30.894863 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:30.895619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:30.902917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:30.902917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:30.902917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:31.057259 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:31.074772 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f6dafa38-a20f-404a-bf19-5f3ebd447ab9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1275 microversion: 2.1 time: 0.195688 Aug 23 16:40:31.076260 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 155/291] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:30 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:31.083217 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:31.083825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:31.090658 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:31.091163 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:31.091599 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:31.092383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:31.092842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:31.093261 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:31.117611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:31.126474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b401301f-44f0-42b6-a860-1c110c17a987 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.376555 Aug 23 16:40:31.127881 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 137/292] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:30 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:31.241721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:31.257407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9510d4ed-c74d-4f11-9de0-3914ad7cd736 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.179713 Aug 23 16:40:31.257930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 156/293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:31 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:31.276238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:31.276936 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:31.283358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:31.283842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:31.284306 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:31.285050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:31.285650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:31.286075 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:31.365240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:31.376034 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ba20aa5e-2bed-4a1e-a503-6af65042aacf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1266 microversion: 2.1 time: 0.104014 Aug 23 16:40:31.389820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 138/294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:31 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:32.099815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:32.100180 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:32.112825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:32.114516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:32.117321 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:32.118149 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:32.119133 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:32.120655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:32.148798 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:32.150083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:32.160784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:32.163314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:32.164697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:32.165679 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:32.166556 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:32.167764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:32.257879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:32.270971 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dfe76df3-bc19-4bc3-97c0-11b2aa778696 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1275 microversion: 2.1 time: 0.177296 Aug 23 16:40:32.273646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 157/295] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:32 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:32.278915 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:32.279803 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:32.291678 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:32.292686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:32.300489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:32.303025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:32.304845 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:32.305464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:32.537941 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:32.546628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ac19bd8f-1466-49e9-a010-65db50da85e5 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.401064 Aug 23 16:40:32.557274 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 139/296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:32 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:32.561377 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:32.562088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:32.570588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:32.577964 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:32.578240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:32.579257 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:32.579739 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:32.580217 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:32.685896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:32.710430 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d4f7bd4e-a981-4cdc-acda-f95562ea52bc tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.431965 Aug 23 16:40:32.711144 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 158/297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:32 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:32.716085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:32.724284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-27f40c43-22ad-4765-b099-5339815dc2d7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1266 microversion: 2.1 time: 0.166566 Aug 23 16:40:32.727234 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 140/298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:32 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:33.297992 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:33.298854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:33.307648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:33.308143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:33.308611 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:33.319906 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:33.320449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:33.320901 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:33.571708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:33.573240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:33.582720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:33.583213 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:33.594277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:33.594277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:33.594277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:33.594277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:33.712587 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:33.720523 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bc3b53a5-7fd4-4e25-8beb-d2d2dd84588b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1273 microversion: 2.1 time: 0.426319 Aug 23 16:40:33.735047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 159/299] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:33 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1273 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:33.748875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:33.750814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:33.766043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:33.766660 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:33.767496 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:33.768440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:33.768977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:33.770072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:33.886897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:33.905849 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:33.920461 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e993a629-95f7-496d-b965-0093b2782029 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.354386 Aug 23 16:40:33.922011 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-90dd585d-a201-4a7d-a90a-66c1e00b263e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1284 microversion: 2.1 time: 0.176937 Aug 23 16:40:33.924064 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 141/300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:33 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:33.926011 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 160/301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:33 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:33.941094 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:33.941713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:33.945168 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:33.949019 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:33.949501 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:33.949990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:33.950747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:33.951277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:33.951686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:34.208593 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:34.217965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-278ef9d2-0116-4f7b-b9f9-b66dcd91b33a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1522 microversion: 2.1 time: 0.292765 Aug 23 16:40:34.218661 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 142/302] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:33 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:34.529169 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-a3b1318b-26fe-41c2-8304-252a70dfe31e req-acccc93f-a5b9-4b70-9d35-8e0929fbe99f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ce2e0d-564c-4b98-b0a5-416658f5968b", "name": "network-vif-plugged", "status": "completed", "tag": "5cdbf042-8797-4daf-8e46-c209712ca749"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:34.542771 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-a3b1318b-26fe-41c2-8304-252a70dfe31e req-acccc93f-a5b9-4b70-9d35-8e0929fbe99f service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:34.543409 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-a3b1318b-26fe-41c2-8304-252a70dfe31e req-acccc93f-a5b9-4b70-9d35-8e0929fbe99f service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:34.543911 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-a3b1318b-26fe-41c2-8304-252a70dfe31e req-acccc93f-a5b9-4b70-9d35-8e0929fbe99f service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:34.556481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-a3b1318b-26fe-41c2-8304-252a70dfe31e req-acccc93f-a5b9-4b70-9d35-8e0929fbe99f service nova] Creating event network-vif-plugged:5cdbf042-8797-4daf-8e46-c209712ca749 for instance d1ce2e0d-564c-4b98-b0a5-416658f5968b on hv-cinder-85032 Aug 23 16:40:34.562437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-a3b1318b-26fe-41c2-8304-252a70dfe31e req-acccc93f-a5b9-4b70-9d35-8e0929fbe99f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039625 Aug 23 16:40:34.563151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 161/303] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:40:34.741747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:34.742933 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:34.755119 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:34.755604 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:34.756041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:34.756774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:34.757223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:34.757810 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:34.955753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:34.968383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:34.971239 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:34.989366 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:34.991584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:34.992596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:34.993694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:34.994461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:34.995075 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:35.034688 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:35.042431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3285dfa3-5e30-4c4d-b423-98986f2685e8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.304430 Aug 23 16:40:35.046222 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 143/304] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:34 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:35.048421 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:35.049869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:35.055973 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:35.056688 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:35.057120 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:35.058000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:35.058452 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:35.058870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:35.155489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=10 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:35.206974 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:35.215129 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-64ea72fa-459e-40b0-ae14-583118ee1a6b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.262048 Aug 23 16:40:35.216008 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 162/305] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:34 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:35.240042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:35.240943 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:35.242926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:35.247693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:35.248201 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:35.248704 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:35.249545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:35.250080 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:35.250641 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:35.251739 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:35.260820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1f823664-7c0d-47bd-820d-88c07a57969b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.216815 Aug 23 16:40:35.261730 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 144/306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:35 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:35.349163 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-3fcee639-013a-47b3-a33f-3d4e5653f632 req-712fd51d-e717-42e6-a314-3309ff83147a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60fffd56-ef88-490e-a52d-e7eef91d7b95", "tag": "3d59c803-b035-4cdc-9fce-a604949b783d"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:35.366688 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-3fcee639-013a-47b3-a33f-3d4e5653f632 req-712fd51d-e717-42e6-a314-3309ff83147a service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:35.367449 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-3fcee639-013a-47b3-a33f-3d4e5653f632 req-712fd51d-e717-42e6-a314-3309ff83147a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:35.368542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-3fcee639-013a-47b3-a33f-3d4e5653f632 req-712fd51d-e717-42e6-a314-3309ff83147a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:35.386882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:35.391356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-3fcee639-013a-47b3-a33f-3d4e5653f632 req-712fd51d-e717-42e6-a314-3309ff83147a service nova] Creating event network-changed:3d59c803-b035-4cdc-9fce-a604949b783d for instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 on hv-cinder-85032 Aug 23 16:40:35.398783 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-3fcee639-013a-47b3-a33f-3d4e5653f632 req-712fd51d-e717-42e6-a314-3309ff83147a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052633 Aug 23 16:40:35.398783 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 145/307] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:40:35.526491 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:35.543781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6fa2a4f5-f63f-44e1-a726-e829aea4cbee tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1502 microversion: 2.1 time: 0.308635 Aug 23 16:40:35.545033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 163/308] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:35 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1502 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:35.566051 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:35.567027 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:35.582107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:35.582107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:35.582107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:35.582107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:35.582486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:35.582486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:35.876131 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:35.884348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b2dd03f9-ed6b-460f-ae6d-090cf37f0f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1515 microversion: 2.1 time: 0.322582 Aug 23 16:40:35.885023 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 146/309] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:35 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:36.064401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:36.065201 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:36.073638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:36.074128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:36.074567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:36.075323 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:36.075825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:36.076282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:36.237021 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:36.237995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:36.244536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:36.245207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:36.245702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:36.246493 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:36.246931 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:36.247354 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:36.277287 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:36.300741 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-286a4bc7-8f22-4963-a8e7-21fb2e58ae89 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.226389 Aug 23 16:40:36.300741 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 164/310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:36 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:36.300741 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:36.300741 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:36.305064 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:36.305622 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:36.306066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:36.306822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:36.307332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:36.307757 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:36.466595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:36.476592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ac65a148-0978-40a0-8c78-2d4f171338fc tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1319 microversion: 2.1 time: 0.243275 Aug 23 16:40:36.477569 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 147/311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:36 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:36.482571 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-83fa730c-7509-43ac-8264-4c915884b0a5 req-dcaf83c9-16fa-4470-9086-bf5d302cb43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416120b8-58dd-404a-86bf-6b41b5790ccc", "tag": "7eee61fd-f595-43a1-bd25-cbec1755a72e"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:36.494286 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-83fa730c-7509-43ac-8264-4c915884b0a5 req-dcaf83c9-16fa-4470-9086-bf5d302cb43b service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:36.494996 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-83fa730c-7509-43ac-8264-4c915884b0a5 req-dcaf83c9-16fa-4470-9086-bf5d302cb43b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:36.495674 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-83fa730c-7509-43ac-8264-4c915884b0a5 req-dcaf83c9-16fa-4470-9086-bf5d302cb43b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:36.510208 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-83fa730c-7509-43ac-8264-4c915884b0a5 req-dcaf83c9-16fa-4470-9086-bf5d302cb43b service nova] Creating event network-changed:7eee61fd-f595-43a1-bd25-cbec1755a72e for instance 416120b8-58dd-404a-86bf-6b41b5790ccc on hv-cinder-85032 Aug 23 16:40:36.516373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-83fa730c-7509-43ac-8264-4c915884b0a5 req-dcaf83c9-16fa-4470-9086-bf5d302cb43b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036725 Aug 23 16:40:36.518051 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 148/312] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:40:36.576578 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:36.585656 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bc75d3ac-070a-4c9d-917d-997983fe779d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.291503 Aug 23 16:40:36.594525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 165/313] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:36 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:37.309906 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:37.310608 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:37.320403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:37.321694 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:37.322328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:37.323223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:37.329793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:37.330539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:37.496618 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:37.497629 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:37.504665 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:37.505439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:37.506095 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:37.507081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:37.507958 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:37.508698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:37.531860 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:37.541992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ca39e1dc-602b-4f08-8a99-10578e0fe94d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.237201 Aug 23 16:40:37.542982 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 149/314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:37 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:37.609446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:37.610055 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:37.617166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:37.617651 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:37.618089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:37.618847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:37.619293 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:37.619915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:37.731539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:37.732478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:37.738416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5d00b055-634e-4ad2-b017-b59d828bc992 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1508 microversion: 2.1 time: 0.245620 Aug 23 16:40:37.738987 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 166/315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:37 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:37.888639 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:37.898903 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1eead8b7-9065-463e-9cbb-81776050fbe8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.293453 Aug 23 16:40:37.899732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 150/316] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:37 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:38.586653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:38.587277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:38.595274 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:38.595769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:38.596240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:38.597020 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:38.597476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:38.598078 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:38.797472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:38.799772 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:38.808463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:38.808960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:38.809396 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:38.810122 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:38.810577 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:38.810999 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:38.839433 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lazy-loading 'flavor' on Instance uuid d6bc7e3a-0456-408f-9de6-b4d4c33413b0 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:40:39.043655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:39.052467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bb9ab593-a5b0-4e5c-ae52-fd2fc8fd23de tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.473065 Aug 23 16:40:39.053044 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 167/317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:38 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:39.058018 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:39.058738 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:39.064773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:39.066071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:39.066498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:39.067193 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:39.067670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:39.068096 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:39.099473 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=20 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:39.218441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8351b19a-6d93-4da8-8e55-e76d3ff58b9e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0/action" status: 200 len: 32 microversion: 2.1 time: 0.425425 Aug 23 16:40:39.224342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 151/318] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:40:38 2022] POST /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0/action => generated 32 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 16:40:39.231044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:39.232974 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:39.241536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:39.242036 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:39.242490 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:39.243479 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:39.243885 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:39.244576 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:39.294456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:39.305078 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7dabb222-c45c-42dc-bf40-4f8e567abb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.250628 Aug 23 16:40:39.307387 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 168/319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:39 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:39.587983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:39.602576 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-492705f8-f712-4fe6-9588-a7d59ab0e5ae tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.376922 Aug 23 16:40:39.603290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 152/320] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:39 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:40.073839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:40.074589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:40.081544 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:40.082223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:40.082667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:40.083431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:40.083949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:40.084531 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:40.303531 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:40.313605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-35e79840-5f82-443c-a858-805faf441a49 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.243477 Aug 23 16:40:40.327339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 169/321] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:40 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:40.327521 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:40.328360 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:40.336619 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:40.337610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:40.338061 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:40.338802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:40.339607 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:40.340040 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:40.546000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:40.556744 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-de093e4d-71eb-47ca-8e46-95d121761210 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.233135 Aug 23 16:40:40.557336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 153/322] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:40 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:40.625257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:40.626142 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:40.632697 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:40.633359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:40.634133 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:40.635410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:40.640589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:40.640795 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:40.868115 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:40.871743 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:40.877110 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3e76ffde-bbeb-4857-b906-958e389b6339 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.255813 Aug 23 16:40:40.877690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 170/323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:40 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:41.336127 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:41.337485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:41.344302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:41.344812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:41.345234 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:41.345952 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:41.346458 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:41.347486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:41.580332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:41.582553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:41.598606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:41.599369 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:41.600054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:41.601156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:41.602095 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:41.602702 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:41.611014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:41.619677 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-dc130f4e-3380-4737-893c-b1f1fdeae1bb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.288450 Aug 23 16:40:41.623942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 154/324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:41 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:41.834825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:41.844094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-61f1256a-919d-43c8-92d5-b2c47f81667b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.267472 Aug 23 16:40:41.844643 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 171/325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:41 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:41.897964 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:41.898643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:41.905436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:41.905932 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:41.906642 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:41.908910 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:41.909404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:41.909838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:42.180906 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:42.194130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8efd0590-479d-418d-99b6-b6cf4928d19d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.300513 Aug 23 16:40:42.199581 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 155/326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:41 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:42.648060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:42.648742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:42.654799 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:42.655228 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:42.655655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:42.656692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:42.657151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:42.657650 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:42.849318 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:42.857891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-92143c1d-c435-42f8-8a85-9e4c26fd29bd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.214188 Aug 23 16:40:42.872574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 172/327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:42 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:42.877585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:42.878202 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:42.884283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:42.885093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:42.885559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:42.886307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:42.887063 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:42.887496 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:43.001918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9885a17e-0305-4ca1-8dd4-e9006ce08e9c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'create', calling method: .version_select at 0x7f677836dca0>, body: {"keypair": {"name": "tempest-keypair-1929487978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQBgTD9x/Z9sLZJc+AKPneNqhP6/3eqrbZviN1lp0XwobWJRAzD4B+lrhnUEXuJP1oU3/IzRBNqp1SKOJjC0V63mZG1KLeAyHK/qGhyPKPpFAJ19h/aeMDmh5r0byOOhA=="}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:43.021155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-9885a17e-0305-4ca1-8dd4-e9006ce08e9c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Getting quotas for project 7bdf236fc9724490a26aeac2b680918b. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:40:43.025097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-9885a17e-0305-4ca1-8dd4-e9006ce08e9c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Getting quotas for user 1ff570c1fa134bcebfd597ded5a95168 and project 7bdf236fc9724490a26aeac2b680918b. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:40:43.055355 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:43.064004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b39fadaa-b003-4ca5-b0d8-5870f4aade81 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.190238 Aug 23 16:40:43.064547 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 173/328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:42 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:43.136644 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9885a17e-0305-4ca1-8dd4-e9006ce08e9c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.294869 Aug 23 16:40:43.140550 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 156/329] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Aug 23 16:40:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 300 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 23 16:40:43.220130 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:43.220734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:43.227438 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:43.227925 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:43.228393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:43.229202 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:43.230083 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:43.230786 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:43.404740 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:43.414968 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2b15b237-89f9-4aa2-811b-4c4c637b426a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.198893 Aug 23 16:40:43.416111 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 174/330] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:43 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:43.883422 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:43.884612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:44.053803 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:44.054994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:44.062711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:44.062711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:44.062711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:44.062711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:44.086468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:44.087648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:44.093954 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:44.094440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:44.094878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:44.095576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:44.096027 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:44.097006 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:44.278595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:44.291644 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d94e2e3c-341a-40e8-b46a-65e27808ee8a tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.414478 Aug 23 16:40:44.292263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 157/331] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:43 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:44.331406 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:44.338675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6a0c181d-32fa-4592-932c-1691c8abb8fc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.255952 Aug 23 16:40:44.339444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 175/332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:44 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:44.441340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:44.443196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:44.459651 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:44.460695 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:44.460695 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:44.465495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:44.465495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:44.465495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:44.651084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:44.670706 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8757400e-2e3d-4e31-a622-ab8fa8686b4e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.226944 Aug 23 16:40:44.684689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 158/333] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:44 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:45.312408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:45.313017 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:45.319506 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:45.320180 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:45.321055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:45.321990 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:45.322523 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:45.323167 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:45.361390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:45.365990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:45.379187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:45.380096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:45.380830 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:45.386679 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:45.387624 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:45.388263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:45.615274 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:45.623767 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:45.630257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ddc48185-94d2-4ec8-8946-eafdef9fe1a2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.321736 Aug 23 16:40:45.631429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 176/334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:45 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:45.633017 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a388d0aa-0537-4602-9e5f-5f271e0f1988 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.275950 Aug 23 16:40:45.639678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 159/335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:45 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:45.693579 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:45.694519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:45.701226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:45.701822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:45.702487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:45.703384 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:45.703928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:45.704645 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:45.875248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:45.888718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-25f3f192-7b39-44e1-b264-3613af4e197b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.199377 Aug 23 16:40:45.889483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 177/336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:45 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:46.221577 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1919115682", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d28766e3-e0fc-4cc9-b12d-6b16a6e8b439"}], "security_groups": [{"name": "tempest-securitygroup--901417122"}], "key_name": "tempest-keypair-1929487978", "user_data": "}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:46.326431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] validate_networks() for [('d28766e3-e0fc-4cc9-b12d-6b16a6e8b439', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:40:46.651717 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:46.652358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:46.658503 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:46.659144 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:46.659461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:46.660429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:46.660617 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:46.661041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:46.733176 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:40:46.733721 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:40:46.734205 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:40:46.734678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:40:46.735099 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:40:46.744943 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:46.745509 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:46.746017 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:46.746878 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:46.747430 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:46.748002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:46.765655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Getting quotas for project 7bdf236fc9724490a26aeac2b680918b. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:40:46.769841 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Getting quotas for user 1ff570c1fa134bcebfd597ded5a95168 and project 7bdf236fc9724490a26aeac2b680918b. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:40:46.781206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:40:46.783599 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:40:46.803576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:46.811363 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f4c53bbf-1982-49be-b621-5dd8c12931d7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.163658 Aug 23 16:40:46.811927 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 178/337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:46 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:46.816335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:46.816958 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:46.822599 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:46.823077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:46.823509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:46.824219 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:46.824671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:46.825088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:46.903105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d61faffd-b756-4d02-b062-39c273b35b49 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.685894 Aug 23 16:40:46.913845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 160/338] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Aug 23 16:40:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 16:40:46.913845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:46.913845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:46.918646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:46.919134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:46.919570 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:46.920302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:46.925520 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:46.926205 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:46.988135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:46.994933 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-998268e8-e572-4e2d-a17e-cd36ec795c13 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.181971 Aug 23 16:40:46.995628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 179/339] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:46 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:47.003559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-70bce367-0ff0-457a-803b-b61f65f4feea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:47.003559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-70bce367-0ff0-457a-803b-b61f65f4feea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:47.091457 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-70bce367-0ff0-457a-803b-b61f65f4feea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:47.103549 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-70bce367-0ff0-457a-803b-b61f65f4feea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:47.105123 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-70bce367-0ff0-457a-803b-b61f65f4feea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:47.106289 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-70bce367-0ff0-457a-803b-b61f65f4feea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1282 microversion: 2.20 time: 0.109414 Aug 23 16:40:47.106858 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 180/340] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:46 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:47.144025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:47.152287 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0540e77c-fadc-4dbf-86df-57cf88d3277c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.245302 Aug 23 16:40:47.153291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 161/341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:46 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:47.833092 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:47.833707 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:47.839917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:47.840436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:47.840880 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:47.841585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:47.842082 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:47.842519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:47.978776 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:47.986337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bb0a06cf-89e5-4c14-a720-e07c1bce2ad0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.158029 Aug 23 16:40:47.987400 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 181/342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:47 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:48.019156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:48.021410 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:48.027304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:48.027740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:48.028264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:48.028970 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:48.029428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:48.029852 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:48.130563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:48.131630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:48.137738 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:48.138221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:48.138704 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:48.139403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:48.139851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:48.140384 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:48.193790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:48.197375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:48.208124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-df1913f3-495d-4ad0-aa48-0331db82cc57 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.192954 Aug 23 16:40:48.212898 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 162/343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:48 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:48.213097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:48.214899 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:48.215512 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:48.223738 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:48.224985 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:48.225482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:48.225723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:48.225920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:48.227150 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f29244b0-3f9e-4b2b-97a9-ab7277fd4e32 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1286 microversion: 2.20 time: 0.101270 Aug 23 16:40:48.227271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:48.227661 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:48.227811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 182/344] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:48 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:48.228562 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:48.363628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:48.371693 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5a00050a-56ad-4f52-af67-932672be6904 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.161290 Aug 23 16:40:48.372678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 163/345] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:48 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:49.008253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:49.010234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:49.014998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:49.015489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:49.015932 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:49.016664 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:49.017152 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:49.017593 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:49.150391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:49.158031 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0db589f6-987f-4c01-85d0-8ac9531fb924 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.153710 Aug 23 16:40:49.158589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 183/346] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:49 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:49.230090 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:49.230708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:49.237641 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:49.238125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:49.238563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:49.239246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:49.239699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:49.240123 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:49.248904 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:49.249596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:49.255944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:49.256466 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:49.256906 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:49.257592 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:49.258048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:49.258533 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:49.334050 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:49.342164 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:49.343694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:49.344848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0da4bcfe-24bb-4c5d-b443-22b64805af98 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1286 microversion: 2.20 time: 0.099744 Aug 23 16:40:49.345421 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 184/347] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:49 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:40:49.393851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:49.394462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:49.400416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:49.400902 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:49.401333 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:49.402049 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:49.402497 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:49.402959 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:49.405493 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:49.413872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b4d6c023-ab9d-4238-b7a6-8fe5cf85bc56 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.188133 Aug 23 16:40:49.424225 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 164/348] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:49 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:49.540240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:49.547931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-17029d6c-c6e8-4af2-9227-c6d409fca81e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.158510 Aug 23 16:40:49.548560 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 185/349] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:49 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:50.178588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:50.179204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:50.185524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:50.186016 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:50.186460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:50.187166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:50.187625 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:50.188079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:50.321166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:50.328751 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-30fb9488-7709-45ed-94c0-1c425a6048cb tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.154012 Aug 23 16:40:50.329314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 165/350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:50 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:50.368993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:50.369601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:50.375603 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:50.376087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:50.376562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:50.377252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:50.377712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:50.378138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:50.434764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:50.435380 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:50.441382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:50.441870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:50.442304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:50.443006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:50.443458 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:50.443888 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:50.446893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:50.454990 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:50.457026 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:50.458139 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-146d29f9-8cad-45f8-85d4-5dabc8f031ed tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1286 microversion: 2.20 time: 0.093130 Aug 23 16:40:50.458692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 186/351] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:50 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:50.569230 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:50.569837 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:50.575827 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:50.576352 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:50.576791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:50.577493 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:50.577944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:50.578053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:50.578373 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:50.586467 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ec84ed29-00b2-4dd2-b452-675df1c7ebf6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.155593 Aug 23 16:40:50.587224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 166/352] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:50 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:50.709659 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:50.717516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9bb00124-943f-4fa5-b225-a3de48cdfa8e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.152635 Aug 23 16:40:50.718112 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 187/353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:50 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:51.349810 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:51.350424 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:51.357287 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:51.357776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:51.358254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:51.358965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:51.359420 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:51.359847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:51.481595 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:51.482888 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:51.490988 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:51.495686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:51.495686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:51.495686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:51.495686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:51.496020 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:51.504010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:51.511822 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-10f49d44-09fe-48e4-92df-ca1d66906229 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.166394 Aug 23 16:40:51.524190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 167/354] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:51 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:51.524381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:51.556903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:51.565184 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:51.566678 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:51.567775 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ca9431b6-e5da-46c5-9d26-ae493e94cc29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1286 microversion: 2.20 time: 0.090077 Aug 23 16:40:51.568427 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 188/355] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:51 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:40:51.607369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:51.607905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:51.614647 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:51.615136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:51.615574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:51.616293 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:51.616749 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:51.617215 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:51.739035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:51.739645 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:51.746052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:51.746777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:51.747278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:51.748129 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:51.754642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:51.755434 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:51.961619 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:51.979712 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a6dc6d0e-940d-4d7c-80d8-a30c94d074dc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.376230 Aug 23 16:40:51.981034 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 168/356] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:51 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:52.136752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:52.147111 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cf510b30-6b04-4e91-934b-767d908f53a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.412301 Aug 23 16:40:52.147926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 189/357] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:51 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:52.533169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:52.533820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:52.540489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:52.540975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:52.541406 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:52.542101 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:52.542717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:52.543561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:52.590348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:52.590954 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:52.597424 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:52.597922 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:52.598351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:52.599051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:52.599496 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:52.600110 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:52.876546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:52.885452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:52.887307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:52.888646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-22c45f38-1e46-4f26-987c-bcae36d758a7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1334 microversion: 2.20 time: 0.302129 Aug 23 16:40:52.889788 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 190/358] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:52 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1334 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:52.938407 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:52.946194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9a23b17e-dd7e-4ee0-892c-55119518bea8 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.416877 Aug 23 16:40:52.946761 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 169/359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:52 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:53.004380 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:53.004991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:53.011003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:53.011527 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:53.011964 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:53.012690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:53.013147 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:53.013613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:53.153332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:53.162012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-93285ea0-dfac-4735-b5b8-5252ddc79715 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.161567 Aug 23 16:40:53.162674 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 191/360] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:52 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:53.168340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:53.168978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:53.175542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:53.176134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:53.180207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:53.180207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:53.180207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:53.180207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:53.316264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:53.323895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-81a7d1bd-d3d3-4bdf-8542-276e951c74e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.159464 Aug 23 16:40:53.324495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 170/361] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:53 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:53.911075 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:53.911874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:53.918137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:53.918664 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:53.919106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:53.919810 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:53.920321 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:53.920753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:53.967115 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:53.967774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:53.974707 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:53.975176 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:53.975611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:53.976348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:53.977066 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:53.977544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:54.008854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:54.008854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:54.009225 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:54.009225 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6be8b0c9-6669-43a3-9674-cbfeefa2c824 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1342 microversion: 2.20 time: 0.087882 Aug 23 16:40:54.009225 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 192/362] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:53 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1342 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:54.114256 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:54.122238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0cdcd3cb-85df-4551-8ea5-1921d9b99c7f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.159209 Aug 23 16:40:54.122818 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 171/363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:53 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:40:54.182692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:54.183218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:54.189393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:54.189879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:54.191007 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:54.191698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:54.192158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:54.197471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:54.324676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:54.332367 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0d8a2480-76cb-48e9-a1c7-0e9d5b682155 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.153901 Aug 23 16:40:54.332924 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 193/364] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:54 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:54.344926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:54.345533 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:54.352864 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:54.354079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:54.354527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:54.355226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:54.355712 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:54.356132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:54.493452 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:54.503762 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-901a1001-bbc4-4539-bd5c-f054f64bad31 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.162369 Aug 23 16:40:54.515715 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 172/365] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:54 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:54.739987 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-c9f2e11e-340f-4b0b-85e3-7519ade62ac5 req-288da7a8-15ce-468d-94e0-ea86305b8845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fffd56-ef88-490e-a52d-e7eef91d7b95", "name": "network-vif-plugged", "status": "completed", "tag": "3d59c803-b035-4cdc-9fce-a604949b783d"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:40:54.749439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-c9f2e11e-340f-4b0b-85e3-7519ade62ac5 req-288da7a8-15ce-468d-94e0-ea86305b8845 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:54.749916 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-c9f2e11e-340f-4b0b-85e3-7519ade62ac5 req-288da7a8-15ce-468d-94e0-ea86305b8845 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:54.750349 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-c9f2e11e-340f-4b0b-85e3-7519ade62ac5 req-288da7a8-15ce-468d-94e0-ea86305b8845 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:54.761924 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-c9f2e11e-340f-4b0b-85e3-7519ade62ac5 req-288da7a8-15ce-468d-94e0-ea86305b8845 service nova] Creating event network-vif-plugged:3d59c803-b035-4cdc-9fce-a604949b783d for instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 on hv-cinder-85032 Aug 23 16:40:54.767143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-c9f2e11e-340f-4b0b-85e3-7519ade62ac5 req-288da7a8-15ce-468d-94e0-ea86305b8845 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Aug 23 16:40:54.768741 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 194/366] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:40:55.017210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:55.017821 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:55.024096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:55.024614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:55.025053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:55.025755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:55.026209 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:55.026633 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:55.088799 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:55.097683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:55.099199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:55.100358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-976df36f-113a-41d7-a852-e738712e5377 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1342 microversion: 2.20 time: 0.086980 Aug 23 16:40:55.100922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 173/367] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:55 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:55.143383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:55.144084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:55.150390 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:55.150830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:55.151270 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:55.151962 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:55.152469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:55.152899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:55.294765 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:55.303286 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3478ec28-cef0-4c11-88f6-64a7649c9542 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.164135 Aug 23 16:40:55.303863 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 195/368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:55 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:55.354841 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:55.355550 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:55.363563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:55.368589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:55.368589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:55.368589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:55.368589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:55.368921 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:55.501777 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:55.509534 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1e839cdc-54ea-4c3f-bb46-c5ff25f77bf8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.159823 Aug 23 16:40:55.510109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 174/369] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:55 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:55.525133 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:55.525735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:55.531815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:55.532333 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:55.532766 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:55.533468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:55.534557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:55.534980 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:55.670592 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:55.678355 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c01593bd-67b8-4c5b-9d8d-bb562236c012 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.157208 Aug 23 16:40:55.678918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 196/370] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:55 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:56.123728 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:56.124380 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:56.131105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:56.131585 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:56.132018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:56.132739 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:56.133189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:56.133613 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:56.194379 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:56.202794 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:56.204336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:56.209563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ee290cd0-54ca-4d7b-af5a-6558213ef4d5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1342 microversion: 2.20 time: 0.085662 Aug 23 16:40:56.209563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 175/371] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:56 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:56.324022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:56.324605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:56.330537 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:56.331020 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:56.331459 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:56.332150 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:56.332624 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:56.333049 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:56.463839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:56.471482 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-62d22c95-1946-486e-8a65-268c2c8f0e72 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.151417 Aug 23 16:40:56.472053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 197/372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:56 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:56.530568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:56.531169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:56.538198 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:56.538673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:56.539148 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:56.539823 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:56.540317 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:56.540736 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:56.671487 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:56.679847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-76c6d960-1c9a-411f-b731-5edac2a04c1a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.153489 Aug 23 16:40:56.680441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 176/373] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:56 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:56.698659 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:56.699271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:56.705302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:56.705797 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:56.706240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:56.706926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:56.707384 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:56.707811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:56.838835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:56.847365 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a12acd7e-5fdf-4c57-ac5d-9562a5124bf3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.152494 Aug 23 16:40:56.847941 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 198/374] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:56 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:57.228339 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:57.229103 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:57.230814 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:57.231489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=10 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:57.236288 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:57.236806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:57.237240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:57.237925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:57.238374 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:57.238793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:57.300114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:57.308711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:57.310214 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:57.311316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0d626fe5-6c03-408b-8552-f4890a2b08c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1342 microversion: 2.20 time: 0.087171 Aug 23 16:40:57.311862 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 177/375] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:57 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1342 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:57.492712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:57.493326 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:57.495381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:57.500241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:57.501885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:57.501885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:57.501885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:57.502934 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:57.503371 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:57.631950 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:57.639822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ab8e7080-f93a-45dc-89a5-ef359ad5dba7 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.151162 Aug 23 16:40:57.640421 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 199/376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:57 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:57.699976 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:57.700659 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:57.712440 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:57.712440 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:57.712440 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:57.712440 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:57.712762 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:57.712762 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:57.842260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:57.849807 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8ebd0c53-975b-4119-83ab-63fb6097fc4f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.153623 Aug 23 16:40:57.850375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 178/377] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:57 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:57.868686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:57.869362 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:57.875408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:57.875793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:57.876270 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:57.877003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:57.878145 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:57.878610 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:58.007963 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:58.015729 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d36a2a97-c94e-41dd-9a5e-ac85167dd342 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.150882 Aug 23 16:40:58.016570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 200/378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:57 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:58.333539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:58.334149 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:58.336044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:58.340729 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:58.341214 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:58.341653 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:58.342346 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:58.342798 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:58.343224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:58.362221 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:40:58.406801 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:58.416077 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:58.417187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:58.418286 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bc71869e-3d50-4a01-b590-e8fa1e2b7d7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1342 microversion: 2.20 time: 0.088696 Aug 23 16:40:58.419155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 179/379] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:58 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1342 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:58.665482 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:58.666035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:58.671996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:58.675524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:58.675524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:58.675524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:58.675524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:58.675868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:58.817736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:58.825367 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8c0eb76d-0bda-4063-8fa5-58ba61be8b9b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.163817 Aug 23 16:40:58.825932 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 201/380] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:58 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:58.870769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:58.871394 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:58.879072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:58.879542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:58.879965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:58.880667 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:58.881112 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:58.881529 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:59.010295 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:59.018692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3b538084-519c-4bb5-b867-7081f4956e74 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.151191 Aug 23 16:40:59.019333 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 180/381] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:58 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:59.037331 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:59.037880 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:59.043880 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:59.044422 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:59.044856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:59.045534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:59.045985 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:59.046407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:59.176403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:59.183914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-84e44ebe-7274-4467-927f-1dea2b69dd82 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.150463 Aug 23 16:40:59.184501 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 202/382] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:59 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:40:59.442679 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:59.443397 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:59.450050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:59.450545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:59.450980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:59.451690 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:59.452144 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:59.452623 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:59.516271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:59.524727 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:59.526241 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:59.527386 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-03b29ca7-5643-4cc5-819c-4dd374c88a76 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1342 microversion: 2.20 time: 0.090935 Aug 23 16:40:59.528052 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 181/383] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:40:59 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1342 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:40:59.846974 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:40:59.847502 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:40:59.853830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:59.854319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:59.854755 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:59.855467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:40:59.855916 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:40:59.856370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:40:59.988378 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:40:59.996190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-abc7f6f6-d7e1-4f42-869d-29caf41f8de6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.153566 Aug 23 16:40:59.996783 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 203/384] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:40:59 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:00.043676 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:00.044827 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:00.056360 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:00.057240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:00.058041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:00.059283 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:00.060131 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:00.060967 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:00.206909 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:00.207628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:00.213714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:00.214205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:00.214645 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:00.215341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:00.215796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:00.216249 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:00.222840 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:00.230982 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d004ab24-52f1-4c21-bdaf-1407087308c3 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.194836 Aug 23 16:41:00.231557 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 182/385] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:00 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:00.344141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:00.352433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c3dca662-6784-4bc1-808d-c8ea634286c6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.150165 Aug 23 16:41:00.352996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 204/386] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:00 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:00.551065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:00.551687 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:00.557584 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:00.558066 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:00.558548 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:00.559204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:00.559657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:00.560084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:00.621702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:00.629827 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:00.634305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:00.634305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-da733c76-aa66-4aac-b76b-203febd5786a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1342 microversion: 2.20 time: 0.086066 Aug 23 16:41:00.634305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 183/387] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:00 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1342 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:01.016464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:01.017084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:01.023122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:01.023613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:01.024340 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:01.024887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:01.025348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:01.025780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:01.156521 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:01.160433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:01.164779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ad176525-69b6-44cd-9282-96273d3a334d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.152129 Aug 23 16:41:01.165341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 205/388] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:01 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:01.252624 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:01.254156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:01.260855 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:01.261333 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:01.265278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:01.265278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:01.265278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:01.265278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:01.373861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:01.374388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:01.381565 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:01.382056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:01.382495 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:01.383192 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:01.383644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:01.384073 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:01.392115 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:01.402616 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c7c7ca18-490e-4c18-b72e-d19dc1283ccc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.154550 Aug 23 16:41:01.403727 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 184/389] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:01 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:01.522875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:01.530591 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-23d86667-018a-44f1-b903-d3ca9684f407 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.160735 Aug 23 16:41:01.531158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 206/390] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:01 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:01.656056 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:01.656703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:01.663183 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:01.663699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:01.664096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:01.664955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:01.665454 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:01.665969 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:01.727652 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:01.735836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:01.737930 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:01.739051 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9f8e6eb8-f859-4731-afcf-ec2aebcc6e22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1342 microversion: 2.20 time: 0.087582 Aug 23 16:41:01.739616 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 185/391] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:01 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1342 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:02.186245 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:02.186780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:02.192763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:02.193258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:02.193702 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:02.194421 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:02.194905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:02.195345 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:02.325018 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:02.336706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e64cfbee-2020-481b-9c8c-fec6c1d47b2e tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.154376 Aug 23 16:41:02.364120 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 207/392] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:02 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:02.422738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:02.423563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:02.430777 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:02.431326 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:02.436353 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:02.436353 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:02.436353 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:02.436353 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:02.550853 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:02.551553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:02.557593 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:02.558303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:02.558792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:02.559579 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:02.560102 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:02.560615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:02.586293 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:02.594476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-872a3ac2-9d5a-4be5-8ccc-600723594397 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.175660 Aug 23 16:41:02.599005 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 186/393] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:02 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:02.749128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:02.757766 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d4770c4f-f23b-4fd8-b966-01b5231cf84e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.210724 Aug 23 16:41:02.758332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 208/394] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:02 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:02.764318 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:02.765480 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:02.772119 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:02.772750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:02.773187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:02.774076 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:02.774386 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:02.774812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:02.850901 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:02.861768 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:02.863789 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:02.865222 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7ca7eed2-93f2-4226-b2d9-83f38608f7c7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1340 microversion: 2.20 time: 0.106141 Aug 23 16:41:02.865979 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 187/395] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:02 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:03.371709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:03.379997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:03.379997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:03.379997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:03.379997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:03.380551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:03.380737 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:03.381173 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:03.514550 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:03.522301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-11325880-5dcc-4682-a8ae-cbeb4ad39b50 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.154396 Aug 23 16:41:03.522861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 209/396] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:03 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:03.618710 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:03.619417 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:03.625999 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:03.626576 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:03.627070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:03.627824 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:03.628300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:03.628717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:03.779637 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:03.780328 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:03.788468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:03.795524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:03.795524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:03.795524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:03.795524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:03.795878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:03.817357 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:03.825697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-fd1a7ceb-e0d1-4b16-8354-0053041b1ef9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.210712 Aug 23 16:41:03.826290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 188/397] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:03 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:03.890082 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:03.891021 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:03.897950 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:03.900340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:03.901048 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:03.901866 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:03.902497 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:03.903455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:03.937658 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:03.947137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-12538eab-cca6-4534-b52a-c232b19ddae5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.171792 Aug 23 16:41:03.948338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 210/398] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:03 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:04.045766 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:04.054178 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:04.056225 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:04.056925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-16d48888-07b9-48d8-9169-348fb43ceb59 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.170945 Aug 23 16:41:04.057516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 189/399] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:03 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:04.197747 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-561728e0-5d5b-4a3f-87ef-4f831a74e26f req-8433bd3b-a5b7-4dc2-a186-80220b60396e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416120b8-58dd-404a-86bf-6b41b5790ccc", "name": "network-vif-plugged", "status": "completed", "tag": "7eee61fd-f595-43a1-bd25-cbec1755a72e"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:04.207821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-561728e0-5d5b-4a3f-87ef-4f831a74e26f req-8433bd3b-a5b7-4dc2-a186-80220b60396e service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:04.208332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-561728e0-5d5b-4a3f-87ef-4f831a74e26f req-8433bd3b-a5b7-4dc2-a186-80220b60396e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:04.208838 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-561728e0-5d5b-4a3f-87ef-4f831a74e26f req-8433bd3b-a5b7-4dc2-a186-80220b60396e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:04.220185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-561728e0-5d5b-4a3f-87ef-4f831a74e26f req-8433bd3b-a5b7-4dc2-a186-80220b60396e service nova] Creating event network-vif-plugged:7eee61fd-f595-43a1-bd25-cbec1755a72e for instance 416120b8-58dd-404a-86bf-6b41b5790ccc on hv-cinder-85032 Aug 23 16:41:04.225147 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-561728e0-5d5b-4a3f-87ef-4f831a74e26f req-8433bd3b-a5b7-4dc2-a186-80220b60396e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031085 Aug 23 16:41:04.225726 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 211/400] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:41:04.542869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:04.543571 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:04.550478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:04.550895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:04.551327 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:04.552023 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:04.552505 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:04.552928 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:04.784302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:04.792540 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ce9fea2e-4413-4930-b8b6-f0d7dcbccfa2 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.253486 Aug 23 16:41:04.804681 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 190/401] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:04 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:04.847589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:04.848446 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:04.850467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:04.855702 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:04.856311 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:04.856813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:04.857715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:04.858170 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:04.858596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:04.968488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:04.969399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:04.976391 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:04.977142 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:04.977581 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:04.978280 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:04.978766 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:04.979341 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:04.996723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:05.009299 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f201a2ac-3c54-47e7-8574-f7293507ff6e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.165933 Aug 23 16:41:05.010513 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 212/402] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:04 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:05.080928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:05.081952 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:05.088721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:05.089157 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:05.091022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:05.091022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:05.091022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:05.091394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:05.271150 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:05.279767 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d62e3053-164e-4b9c-936b-9cf9f8ec9c8f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.315323 Aug 23 16:41:05.280386 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 191/403] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:04 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:05.317849 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:05.325971 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:05.332015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:05.332015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c4c7bd51-eb99-48a2-976f-fae10b5a6666 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.252549 Aug 23 16:41:05.332015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 213/404] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:05 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:05.501200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-27c22dca-a6b3-4667-a40a-0f9b3e93db0a req-4a85df88-281d-4580-a334-4119c9277b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8", "tag": "e24378e6-7626-4b59-81eb-752fbcca503a"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:05.508873 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-27c22dca-a6b3-4667-a40a-0f9b3e93db0a req-4a85df88-281d-4580-a334-4119c9277b44 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:05.509351 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-27c22dca-a6b3-4667-a40a-0f9b3e93db0a req-4a85df88-281d-4580-a334-4119c9277b44 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:05.509774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-27c22dca-a6b3-4667-a40a-0f9b3e93db0a req-4a85df88-281d-4580-a334-4119c9277b44 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:05.521848 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-27c22dca-a6b3-4667-a40a-0f9b3e93db0a req-4a85df88-281d-4580-a334-4119c9277b44 service nova] Creating event network-changed:e24378e6-7626-4b59-81eb-752fbcca503a for instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 on hv-cinder-85032 Aug 23 16:41:05.526725 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-27c22dca-a6b3-4667-a40a-0f9b3e93db0a req-4a85df88-281d-4580-a334-4119c9277b44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032748 Aug 23 16:41:05.527318 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 192/405] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:41:05.813942 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:05.815187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:05.821432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:05.821964 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:05.822407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:05.823146 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:05.823613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:05.824043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:05.970081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:05.979444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-49638393-119f-48b5-b781-cb2c1e8e6e4c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1315 microversion: 2.1 time: 0.169496 Aug 23 16:41:05.986842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 214/406] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:05 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:06.032117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:06.032853 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:06.039099 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:06.039578 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:06.040010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:06.040728 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:06.041180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:06.041602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:06.178575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:06.186493 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ba15526a-f31f-446b-8e30-6e1b6164b5e6 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.159035 Aug 23 16:41:06.187072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 193/407] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:06 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:06.301915 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:06.302519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:06.308425 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:06.308908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:06.309342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:06.310020 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:06.310469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:06.310890 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:06.351330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:06.352417 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:06.358595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:06.359114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:06.359551 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:06.360302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:06.360765 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:06.361377 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:06.489857 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:06.498410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-24a272f5-71ba-4220-899e-fc957fa4c716 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.200823 Aug 23 16:41:06.499115 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 215/408] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:06 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:06.519113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:06.527304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:06.528881 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:06.529997 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ad62e286-6e58-4aad-8fcb-ce211a53c77c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.182605 Aug 23 16:41:06.530560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 194/409] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:06 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:07.001719 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:07.002829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:07.009084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.009575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.010013 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.010711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.011162 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.011587 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.143908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:07.151522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f8f74965-ed05-4aa6-b172-39d950ab0ed1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1464 microversion: 2.1 time: 0.153935 Aug 23 16:41:07.152084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 216/410] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:06 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:07.197534 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:07.198057 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:07.204677 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.205723 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.206168 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.206916 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.207380 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.207805 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.209379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:07.209999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:07.215963 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.216494 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.216934 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.217637 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.218094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.218520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.234559 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:41:07.271156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:07.354152 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:07.361861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1bcf0d42-e244-4670-8539-3ba1bed82b4d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.156832 Aug 23 16:41:07.362428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 217/411] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:07 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:07.521389 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:07.522065 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:07.529316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.529800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.530230 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.530924 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.531377 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.531797 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.665658 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:07.674449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a9974e3d-dfaa-4984-b87c-13766953995b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.156009 Aug 23 16:41:07.674624 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 218/412] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:07 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:07.678948 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:07.679549 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:07.685234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.685764 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.686213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.686908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.687363 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.687834 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.699949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-788e93f9-837d-4c82-8efa-c36b0c8418e9 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "DELETE /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 204 len: 0 microversion: 2.1 time: 0.505979 Aug 23 16:41:07.700655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 195/413] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:41:07 2022] DELETE /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:41:07.708944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:07.714518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:07.715378 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.715850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.716309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.717063 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:07.717510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:07.717924 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:07.868719 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:07.877320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:07.878843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:07.879960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-883d2c6f-4c60-4e1b-9fbc-6578a55bb86b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.204548 Aug 23 16:41:07.894891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 219/414] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:07 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:07.899929 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:07.907698 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-34a4536f-8f6b-46c5-a11b-17e58908e1b0 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.202775 Aug 23 16:41:07.908812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 196/415] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:07 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:08.382084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:08.382698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:08.388684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:08.389165 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:08.389601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:08.390286 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:08.390738 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:08.391162 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:08.521804 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:08.529413 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a807214c-6abe-4938-89fc-93e43f29d796 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.151162 Aug 23 16:41:08.529967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 220/416] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:08 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:08.695395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:08.696009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:08.702536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:08.703042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:08.703477 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:08.704200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:08.704643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:08.705694 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:08.831290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:08.839071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2e61f25e-e85f-4573-bee3-f4d104cd1d2e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.147517 Aug 23 16:41:08.839986 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 197/417] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:08 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:08.902451 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:08.903054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:08.909015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:08.909495 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:08.909924 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:08.910601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:08.911046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:08.911468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:08.929778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:08.930401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:08.936377 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:08.936864 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:08.937304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:08.938001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:08.938459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:08.938882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:09.093982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:09.103029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:09.104570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:09.105792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8c5b2d15-7e78-486c-9811-9528d79ab406 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.207247 Aug 23 16:41:09.106351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 221/418] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:08 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:09.117506 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:09.125338 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-02d4a584-9f9c-45a6-be6c-ebfe583e9cfd tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.199452 Aug 23 16:41:09.125904 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 198/419] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:08 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:09.549746 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:09.550298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:09.556392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:09.556877 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:09.557315 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:09.558006 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:09.558459 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:09.558888 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:09.690443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:09.698056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3e4149c4-4881-4eae-a633-11a33d0d5519 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.152265 Aug 23 16:41:09.698766 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 222/420] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:09 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:09.861678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:09.862254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:09.868865 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:09.869345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:09.869774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:09.870461 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:09.870906 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:09.871327 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:10.008269 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:10.016017 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9808376a-5146-46f1-a4fb-7466bee93316 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.158797 Aug 23 16:41:10.016624 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 199/421] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:09 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:10.128001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:10.128615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:10.134555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:10.135042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:10.135481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:10.136188 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:10.136653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:10.137084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:10.142214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:10.146237 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:10.146850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:10.152800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:10.156330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:10.156330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:10.156330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:10.156330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:10.156669 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:10.332388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:10.336878 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:10.341146 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:10.342658 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:10.343781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-183dccd2-391b-48f2-bc97-7972f835ae6a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.219825 Aug 23 16:41:10.344558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 223/422] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:10 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:10.345111 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d69dfe0e-b3e9-4ec1-b910-59e8d7511103 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.202626 Aug 23 16:41:10.346301 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 200/423] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:10 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:10.718953 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:10.719568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:10.726573 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:10.727310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:10.727778 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:10.728535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:10.728990 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:10.729419 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:10.857333 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:10.865186 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-abf67d07-3b8d-4864-841f-afdc9d5e9b29 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.150169 Aug 23 16:41:10.865750 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 224/424] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:10 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:11.036471 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:11.037080 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:11.043426 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:11.043904 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:11.044373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:11.045068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:11.045518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:11.045939 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:11.173641 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:11.181872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6ee0c457-633f-47b6-8bfd-212ee404c449 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.149398 Aug 23 16:41:11.182441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 201/425] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:11 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:11.367544 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:11.367954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:11.368187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:11.368610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:11.374254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:11.374549 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:11.374663 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:11.375035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:11.375156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:11.375479 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:11.375780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:11.376156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:11.376264 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:11.376630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:11.376737 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:11.377633 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:11.577349 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:11.580732 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:11.589332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:11.591025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:11.592346 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1d7f1567-73d6-4996-8e3f-6b1391442aea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.228721 Aug 23 16:41:11.592892 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 225/426] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:11 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:11.597624 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2b6fd746-25a8-4dd2-9fa7-cdd30b63f458 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.233479 Aug 23 16:41:11.598200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 202/427] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:11 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:11.885764 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:11.886475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:11.892296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:11.893207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:11.893637 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:11.894312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:11.894766 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:11.895189 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:12.203006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:12.203524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:12.212796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:12.213286 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:12.213721 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:12.214427 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:12.214883 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:12.215303 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:12.474370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:12.484373 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ea1f4a75-d9f9-447c-ac06-b5946f68183e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.602345 Aug 23 16:41:12.493836 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 226/428] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:11 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:12.500911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:12.509497 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a934cd2d-bed1-4561-9c89-68164de28737 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.310554 Aug 23 16:41:12.510063 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 203/429] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:12 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:12.614630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:12.615231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:12.618345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:12.619113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:12.621310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:12.621793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:12.622398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:12.623167 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:12.623539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:12.623967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:12.626154 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:12.627769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:12.628443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:12.629375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:12.630043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:12.630561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:12.824410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:12.828649 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:12.833048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:12.834591 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:12.835662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0a269c87-e044-432b-9731-a683dfad340f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.224904 Aug 23 16:41:12.836242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 227/430] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:12 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:12.836403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-807381bc-7252-4057-93dd-aa6b5f9fe9e5 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.222276 Aug 23 16:41:12.836795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 204/431] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:12 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:13.504763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:13.505374 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:13.511567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:13.512058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:13.512527 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:13.513227 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:13.513667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:13.514094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:13.531125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:13.532567 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:13.539882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:13.540632 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:13.541233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:13.542173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:13.542784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:13.543367 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:13.713411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:13.718034 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:13.723947 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a3e50e57-497e-4c16-8c70-9b2f566372ca tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.222898 Aug 23 16:41:13.724559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 228/432] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:13 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:13.724710 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a6844a94-1133-45d3-ac9b-dbb4e1852669 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.197652 Aug 23 16:41:13.725209 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 205/433] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:13 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:13.857546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:13.858155 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:13.860772 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:13.861843 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:13.865843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:13.866407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:13.866919 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:13.867677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:13.868444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:13.868953 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:13.869544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:13.870400 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:13.871693 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:13.873476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:13.874122 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:13.874648 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:14.060371 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:14.069185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:14.070742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:14.071843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e3e53d78-0d3f-474c-b3b9-e5c9707a395f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.218126 Aug 23 16:41:14.072481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 229/434] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:13 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:14.075552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:14.083841 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b5e2d73a-0cfd-4d00-af9c-1ea93526aa05 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.228037 Aug 23 16:41:14.084428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 206/435] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:13 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:14.744713 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:14.745326 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:14.745613 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:14.746246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:14.751447 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:14.751936 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:14.752411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:14.752841 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:14.753107 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:14.753821 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:14.754074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:14.754247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:14.754504 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:14.754926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:14.755374 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:14.755790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:15.025350 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:15.033399 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-20222186-b901-4080-ba05-bd09ca5c3482 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.292504 Aug 23 16:41:15.033880 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:15.036335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 230/436] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:14 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:15.042848 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c69ae991-5543-4086-a0af-f2057b81bf15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.300884 Aug 23 16:41:15.050969 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 207/437] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:14 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:15.094463 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:15.095075 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:15.101035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:15.104601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:15.104601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:15.104601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:15.104601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:15.104932 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:15.105027 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:15.105462 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:15.111532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:15.112016 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:15.112476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:15.113800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:15.114188 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:15.114606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:15.306467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:15.310653 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:15.314872 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:15.316413 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:15.317565 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0b544360-8735-48b5-b165-a9548068067e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.226987 Aug 23 16:41:15.318132 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 231/438] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:15 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:15.318289 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-177070af-f5b9-4d22-8e66-6419cf927497 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.217532 Aug 23 16:41:15.318859 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 208/439] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:15 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:16.054000 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:16.054570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:16.060724 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:16.061213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:16.061653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:16.062354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:16.062840 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:16.063352 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:16.064624 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:16.065297 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:16.071900 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:16.072405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:16.072895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:16.073594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:16.074052 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:16.074530 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:16.257482 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:16.261581 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:16.265467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4008a7c4-8aeb-4fa0-afe8-5706b81a43c9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.215437 Aug 23 16:41:16.266123 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 232/440] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:16 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:16.270036 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e82f6cd0-a1d2-4b20-83d5-8c7273588b2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.209239 Aug 23 16:41:16.270629 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 209/441] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:16 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:16.339049 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:16.339571 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:16.340147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:16.340781 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:16.345468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:16.345952 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:16.346385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:16.346680 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:16.347189 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:16.347296 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:16.347626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:16.347985 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:16.348394 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:16.348644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:16.348856 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:16.349282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:16.543846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:16.548002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:16.552151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f9c442a7-44a9-4246-bc1c-6cb30efa649b tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.216973 Aug 23 16:41:16.552761 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 233/442] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:16 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:16.557212 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:16.558745 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:16.559848 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6ff719e4-6950-4e41-9895-f0c1f820de5b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.223486 Aug 23 16:41:16.560414 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 210/443] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:16 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:17.286598 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:17.287253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:17.290771 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:17.291386 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:17.293298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:17.293813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:17.294250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:17.294943 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:17.295412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:17.295823 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:17.297707 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:17.298180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:17.298606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:17.299288 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:17.299733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:17.300683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:17.495359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:17.498441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:17.502087 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:17.503312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7a960179-7dcc-4fdd-8a44-98df6edf53bc tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.220680 Aug 23 16:41:17.503959 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 234/444] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:17 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:17.506588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d708de73-3bce-4cf3-bd35-4dc0358e522d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.219567 Aug 23 16:41:17.507151 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 211/445] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:17 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:17.572361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:17.572974 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:17.579258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:17.579745 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:17.580205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:17.580899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:17.581379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:17.581807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:17.582957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:17.583598 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:17.590304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:17.590933 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:17.591406 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:17.592275 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:17.592729 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:17.593154 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:17.777931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:17.781217 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:17.786393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e39b6fa0-bd05-43ab-8fc9-4125aab2fbea tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.217935 Aug 23 16:41:17.787032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 235/446] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:17 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:17.790123 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:17.791635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:17.792771 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b3818530-7161-403a-b6c4-828f5fb070e7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.214064 Aug 23 16:41:17.793475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 212/447] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:17 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:18.523708 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:18.524351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:18.526634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:18.527255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:18.530439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:18.530928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:18.531372 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:18.532067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:18.532561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:18.532993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:18.533756 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:18.534245 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:18.535240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:18.536046 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:18.536550 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:18.536984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:18.728773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:18.732612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:18.736662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4ec301bb-d246-4d52-8f1a-d163187c8133 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.216783 Aug 23 16:41:18.737240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 236/448] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:18 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:18.740395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-019eb778-2609-41d1-a63a-d165863af023 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.217499 Aug 23 16:41:18.740958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 213/449] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:18 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:18.807160 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:18.807873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:18.814220 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:18.814712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:18.814913 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:18.815150 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:18.815550 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:18.815852 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:18.816342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:18.816775 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:18.821622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:18.822686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:18.822686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:18.823225 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:18.823668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:18.824092 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:19.010566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:19.015299 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:19.018276 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-16b62e8d-0db9-42ab-9863-33712cfbfd36 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.215101 Aug 23 16:41:19.018877 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 237/450] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:18 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:19.024587 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:19.026153 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:19.027447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a22f79f1-c0f7-4803-8e41-89cdeb182468 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.216627 Aug 23 16:41:19.028055 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 214/451] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:18 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:19.759088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:19.759731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:19.759875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:19.760582 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:19.765824 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:19.766315 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:19.766755 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:19.766940 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:19.767422 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:19.767546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:19.767863 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:19.767982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:19.768377 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:19.768584 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:19.769598 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:19.770025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:19.971482 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:19.974941 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:19.979852 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-79a7b5dc-215f-48d2-8c69-196b3da60406 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.224645 Aug 23 16:41:19.980461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 238/452] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:19 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:19.983065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-91a941b5-6c5b-4848-ba60-c3eda1a2858d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.226945 Aug 23 16:41:19.983632 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 215/453] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:19 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:20.040187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:20.040811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:20.047167 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:20.047651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:20.048088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:20.048510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:20.048800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:20.049123 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:20.049250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:20.049673 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:20.055199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:20.055711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:20.056146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:20.056886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:20.057337 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:20.057758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:20.253135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:20.256397 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:20.256641 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:20.261153 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7e2f0708-89b6-459a-b5b0-53a9a4e368c1 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.224868 Aug 23 16:41:20.261726 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 239/454] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:20 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:20.265486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:20.267032 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:20.268185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-eb6051df-1593-4e84-a555-0723376db64a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.223408 Aug 23 16:41:20.269304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 216/455] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:20 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:21.000652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:21.001452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:21.003919 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:21.005254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:21.008514 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:21.009004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:21.009443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:21.010140 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:21.010600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:21.011029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:21.012263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:21.012746 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:21.013180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:21.013871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:21.014324 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:21.016140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:21.224677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:21.228688 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:21.244698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2ff27dad-a9dc-4a26-850a-6f4caa82d4a4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.236135 Aug 23 16:41:21.244698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 240/456] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:20 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:21.245833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9b6b884d-fde3-432c-b949-2331deac48cd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.236874 Aug 23 16:41:21.245833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 217/457] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:20 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:21.285832 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:21.285832 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:21.291483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:21.292211 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:21.293846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:21.294641 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:21.295445 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:21.296402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:21.297026 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:21.297653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:21.298262 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:21.298813 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:21.299264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:21.299990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:21.301022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:21.301436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:21.498634 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:21.502541 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:21.507712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-47234ed4-c71e-4a33-a3b0-5b029bd9976c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.228263 Aug 23 16:41:21.508608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 241/458] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:21 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:21.510897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:21.512408 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:21.512993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-fa1e55e5-a6d1-44f8-8b1a-d55afc98be56 req-bc679a86-16b7-40b0-80df-132accde7195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fffd56-ef88-490e-a52d-e7eef91d7b95", "name": "network-vif-unplugged", "status": "completed", "tag": "3d59c803-b035-4cdc-9fce-a604949b783d"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:21.513850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-af006f07-9e28-4399-b4d5-027baf73f246 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.226200 Aug 23 16:41:21.514573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 218/459] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:21 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:21.522937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-fa1e55e5-a6d1-44f8-8b1a-d55afc98be56 req-bc679a86-16b7-40b0-80df-132accde7195 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:21.523564 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-fa1e55e5-a6d1-44f8-8b1a-d55afc98be56 req-bc679a86-16b7-40b0-80df-132accde7195 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:21.524357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-fa1e55e5-a6d1-44f8-8b1a-d55afc98be56 req-bc679a86-16b7-40b0-80df-132accde7195 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:21.537442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-fa1e55e5-a6d1-44f8-8b1a-d55afc98be56 req-bc679a86-16b7-40b0-80df-132accde7195 service nova] Creating event network-vif-unplugged:3d59c803-b035-4cdc-9fce-a604949b783d for instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 on hv-cinder-85032 Aug 23 16:41:21.543977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-fa1e55e5-a6d1-44f8-8b1a-d55afc98be56 req-bc679a86-16b7-40b0-80df-132accde7195 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034283 Aug 23 16:41:21.544721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 242/460] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:41:22.255355 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:22.255966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:22.258505 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:22.259231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:22.262576 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:22.263062 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:22.263495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:22.264221 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:22.264677 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:22.265132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:22.265351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:22.265842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:22.266279 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:22.266969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:22.267425 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:22.267858 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:22.466225 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:22.473549 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:22.474952 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8b6939ab-9ed6-4920-82e0-78aee5342dbf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1314 microversion: 2.1 time: 0.223878 Aug 23 16:41:22.475668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 219/461] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:22 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:22.482241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2ab4681a-c841-4c5a-aaab-8187b71e30f4 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.227808 Aug 23 16:41:22.483083 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 243/462] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:22 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:22.528962 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:22.529792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:22.535838 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:22.536478 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:22.536915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:22.537526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:22.538001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:22.538796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:22.539249 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:22.539671 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:22.542528 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:22.542970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:22.543416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:22.544254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:22.544586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:22.545011 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:22.805835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:22.806217 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:22.810222 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0c68f7ec-7dcd-4164-9a1f-47f003e8b90f tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.286090 Aug 23 16:41:22.810795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 220/463] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:22 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:22.814604 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:22.816671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:22.817775 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a70481a0-9299-4d09-829b-fc95fc3e8f77 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.285753 Aug 23 16:41:22.818464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 244/464] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:22 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:23.496522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:23.497358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:23.503202 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:23.504408 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:23.504896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:23.505236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:23.505359 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:23.506196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:23.506475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:23.507023 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:23.511862 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:23.515504 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:23.515504 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:23.515504 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:23.515504 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:23.515912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:23.923761 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:23.928554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:23.932438 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8984c626-64d0-4ee8-989f-895b3b3db98b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.433161 Aug 23 16:41:23.941257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 245/465] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:23 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:23.941257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:23.941257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:23.944904 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:23.945012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:23.945437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:23.946138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:23.946441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a9441ec8-bc27-47bb-a58b-33c61b296c89 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1498 microversion: 2.1 time: 0.453444 Aug 23 16:41:23.946592 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:23.947203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:23.959257 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 221/466] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:23 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1498 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:23.967005 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:23.967417 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:23.975356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:23.975863 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:23.976302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:23.976995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:23.977780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:23.978106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:24.275496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:24.279567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:24.284196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:24.285860 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:24.286978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-45a061b3-ba06-45c8-918c-6b642f9280d0 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.325920 Aug 23 16:41:24.287347 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9a5a4c59-3d14-474d-8f59-e2c43e491992 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1470 microversion: 2.1 time: 0.353010 Aug 23 16:41:24.287539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 222/467] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:23 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:24.287896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 246/468] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:23 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:24.714483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-34f78e9c-e305-4d27-810f-b9746b5b121a req-690d6c65-e0b3-4553-bb14-e67af6b2630a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60fffd56-ef88-490e-a52d-e7eef91d7b95", "name": "network-vif-deleted", "tag": "3d59c803-b035-4cdc-9fce-a604949b783d"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:24.723868 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-34f78e9c-e305-4d27-810f-b9746b5b121a req-690d6c65-e0b3-4553-bb14-e67af6b2630a service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:24.724393 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-34f78e9c-e305-4d27-810f-b9746b5b121a req-690d6c65-e0b3-4553-bb14-e67af6b2630a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:24.724826 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-34f78e9c-e305-4d27-810f-b9746b5b121a req-690d6c65-e0b3-4553-bb14-e67af6b2630a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:24.736204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-34f78e9c-e305-4d27-810f-b9746b5b121a req-690d6c65-e0b3-4553-bb14-e67af6b2630a service nova] Creating event network-vif-deleted:3d59c803-b035-4cdc-9fce-a604949b783d for instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 on hv-cinder-85032 Aug 23 16:41:24.742085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-34f78e9c-e305-4d27-810f-b9746b5b121a req-690d6c65-e0b3-4553-bb14-e67af6b2630a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031261 Aug 23 16:41:24.742678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 223/469] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:41:24.954900 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:24.957970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:24.961603 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:24.962090 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:24.962529 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:24.963231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:24.963682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:24.964107 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.038707 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:25.039553 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:25.046522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.047007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.047432 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.048122 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.048600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.055020 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.077387 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:41:25.106586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:25.115067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5d198783-7bcc-4ff6-a6b7-9db4041693b0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.164152 Aug 23 16:41:25.115929 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 247/470] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:24 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:25.148927 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1709e87a-04a1-435a-aab8-3a51c6afcff4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59e0dd63-1122-425c-96ca-b2029509ef14", "device": "/dev/sdb"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:25.151807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1709e87a-04a1-435a-aab8-3a51c6afcff4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:25.157751 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1709e87a-04a1-435a-aab8-3a51c6afcff4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.158234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1709e87a-04a1-435a-aab8-3a51c6afcff4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.158673 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1709e87a-04a1-435a-aab8-3a51c6afcff4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.159897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1709e87a-04a1-435a-aab8-3a51c6afcff4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.160391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1709e87a-04a1-435a-aab8-3a51c6afcff4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.160843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1709e87a-04a1-435a-aab8-3a51c6afcff4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.335459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:25.419784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e71dff6d-b7e3-4ae9-aa48-ca56ed5d60cf tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "DELETE /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 204 len: 0 microversion: 2.1 time: 0.385603 Aug 23 16:41:25.420404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 224/471] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:41:25 2022] DELETE /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:41:25.426054 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:25.426758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:25.432719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.433221 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.433656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.434431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.434915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.435342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.504232 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:25.512094 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f7845b7b-5e5e-45a9-81f2-066521bf1d99 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1428 microversion: 2.1 time: 0.090584 Aug 23 16:41:25.512705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 225/472] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:25 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:25.517194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:25.517825 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:25.523511 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.523985 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.524674 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.525216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.525664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.526084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.657873 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:25.666414 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:25.668047 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:25.669186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-96fcc209-894f-4dfc-8ada-a61e7f286edc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.155570 Aug 23 16:41:25.669750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 226/473] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:25 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:25.674299 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:25.675404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:25.681180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.681665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.682102 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.682793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:25.683247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:25.683679 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:25.702108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:25.841611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:25.851639 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3e94ebab-0961-433c-882c-25b702989dce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1504 microversion: 2.1 time: 0.180872 Aug 23 16:41:25.853006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 227/474] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:25 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:26.134942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:26.135678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:26.142469 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:26.142958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:26.143387 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:26.144626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:26.145084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:26.145537 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:26.278488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:26.286788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-db019f03-fc0a-49e9-9d54-045f5d195038 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.155756 Aug 23 16:41:26.287361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 228/475] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:26 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:26.533522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:26.534207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:26.540325 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:26.540807 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:26.541240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:26.541921 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:26.542543 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:26.542970 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:26.605131 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:26.612969 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-af2a84fe-dbbb-4eea-b17e-bba1e7b4158d tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1300 microversion: 2.1 time: 0.083289 Aug 23 16:41:26.613527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 229/476] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:26 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:26.692624 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:26.693238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:26.699179 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:26.699660 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:26.700102 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:26.700819 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:26.701273 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:26.701698 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:26.830006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:26.839569 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:26.841131 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:26.842247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-36cb1886-48e5-4575-aedd-bf7dc7879c45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.154236 Aug 23 16:41:26.842810 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 230/477] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:26 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:26.873098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:26.873711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:26.880601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:26.881143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:26.881581 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:26.882284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:26.882723 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:26.883150 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:27.016855 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:27.024602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-33b969eb-ef26-4449-8119-620368c44bd2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1504 microversion: 2.1 time: 0.155062 Aug 23 16:41:27.025165 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 231/478] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:26 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:27.307047 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:27.307653 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:27.314498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:27.314982 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:27.315472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:27.316200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:27.316685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:27.317111 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:27.452600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:27.460721 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-909bca1c-b5d7-4f87-80d0-0bcd0acad9af tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.157500 Aug 23 16:41:27.461395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 232/479] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:27 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:27.632870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:27.633664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:27.640254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:27.640377 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:27.640750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:27.641433 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:27.641880 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:27.642288 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:27.674385 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:27.674897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:27.675299 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:27.675788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lazy-loading 'fault' on Instance uuid 60fffd56-ef88-490e-a52d-e7eef91d7b95 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:41:27.715973 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:27.724380 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-10cad056-59fc-4913-9d88-2f8158e27051 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1305 microversion: 2.1 time: 0.095284 Aug 23 16:41:27.724938 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 233/480] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:27 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:27.864800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:27.865500 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:27.871429 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:27.871908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:27.872371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:27.873049 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:27.873536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:27.873909 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:27.922240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1709e87a-04a1-435a-aab8-3a51c6afcff4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "POST /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.777049 Aug 23 16:41:27.932925 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 248/481] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:41:25 2022] POST /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b/os-volume_attachments => generated 194 bytes in 2789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:41:28.020375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:28.028643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:28.030146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:28.031271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cd7f246c-262f-4ecd-8f29-9ea9ca56e97c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.170352 Aug 23 16:41:28.031829 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 234/482] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:27 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:28.045645 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:28.048773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:28.052951 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:28.053439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:28.053915 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:28.054596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:28.055215 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:28.055595 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:28.188070 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:28.196307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f409b084-7723-4df3-8813-5f4efcdebe37 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1504 microversion: 2.1 time: 0.155008 Aug 23 16:41:28.196900 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 249/483] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:28 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:28.482725 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:28.483341 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:28.490605 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:28.491097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:28.491532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:28.492260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:28.492719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:28.493147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:28.630088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:28.638208 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c985916c-fd93-4bcb-b80c-d5e6f58f0154 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.159435 Aug 23 16:41:28.638835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 235/484] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:28 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:28.746227 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:28.746830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:28.753187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:28.753669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:28.754125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:28.754804 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:28.755250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:28.755673 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:28.785970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:28.786444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:28.786872 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:28.787310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lazy-loading 'fault' on Instance uuid 60fffd56-ef88-490e-a52d-e7eef91d7b95 {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:41:28.830734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:28.838331 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5c993e9e-448b-4e4e-8082-c87edf96cd34 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1305 microversion: 2.1 time: 0.095905 Aug 23 16:41:28.838894 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 250/485] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:28 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:29.053895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:29.054636 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:29.060767 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:29.061253 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:29.061708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:29.062397 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:29.062908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:29.063332 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:29.216541 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:29.218066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:29.219444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:29.225667 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:29.226455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:29.227037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:29.227179 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:29.227937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:29.228759 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-99aa7952-7790-4ef2-8836-ca7b3392b7c2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.179734 Aug 23 16:41:29.229002 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:29.229364 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 236/486] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:29 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:29.229770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:29.230290 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:29.369305 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:29.377025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f13f9b6c-57ba-424c-8aa8-f45d577df5fb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1504 microversion: 2.1 time: 0.163245 Aug 23 16:41:29.377660 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 251/487] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:29 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:29.659049 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:29.659664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:29.666546 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:29.667033 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:29.667471 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:29.668204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:29.669912 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:29.669912 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:29.802799 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:29.811157 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-011f9810-09ae-41a0-88c7-dad58b02cd83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.156060 Aug 23 16:41:29.811739 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 237/488] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:29 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:29.859526 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:29.860135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:29.867121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:29.870601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:29.870601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:29.870601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:29.870601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:29.870965 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:29.900272 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:29.900884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:29.901194 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:29.901654 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lazy-loading 'fault' on Instance uuid 60fffd56-ef88-490e-a52d-e7eef91d7b95 {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:41:29.946662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:29.954292 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2f07b637-5e5f-4a8a-a8c3-ae78c609d28c tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1305 microversion: 2.1 time: 0.098721 Aug 23 16:41:29.954983 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 252/489] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:29 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:30.251327 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:30.252011 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:30.258035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:30.258453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:30.258884 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:30.259565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:30.260019 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:30.260461 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:30.391190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:30.399519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:30.401039 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:30.402848 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:30.404531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:30.406271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1874eb6e-f18f-4f3a-a9fb-fa1609bcf9da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.158813 Aug 23 16:41:30.407569 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 238/490] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:30 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:30.410640 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:30.411130 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:30.411563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:30.412292 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:30.412739 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:30.413849 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:30.556547 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:30.565801 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4db8d471-70c6-4c02-8fff-3ce1a065980c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1504 microversion: 2.1 time: 0.169826 Aug 23 16:41:30.565801 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 253/491] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:30 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:30.832956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:30.833568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:30.840011 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:30.840547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:30.841006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:30.841706 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:30.842156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:30.842579 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:30.974804 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:30.975717 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:30.980303 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:30.982949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:30.983443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:30.983878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:30.984607 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:30.985055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:30.985475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:30.989263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-07aa2548-82f4-4c4c-a230-afdcf24d1d48 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.160595 Aug 23 16:41:30.989849 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 239/492] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:30 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:31.017786 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:31.018255 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:31.018686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:31.019125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lazy-loading 'fault' on Instance uuid 60fffd56-ef88-490e-a52d-e7eef91d7b95 {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:41:31.059886 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71044fadc41c4a78837c5cfeefb5b858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebc216b3b834c64b9050e5be8ca1154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:31.063623 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:31.068737 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0f3d4d6f-f3b7-4458-a17b-8cccf5e365d6 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 200 len: 1305 microversion: 2.1 time: 0.098323 Aug 23 16:41:31.069347 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 254/493] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:30 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:31.437313 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:31.439861 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:31.460522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:31.461778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:31.461778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:31.462611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:31.464748 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:31.465199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:31.585988 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:31.586607 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:31.594448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:31.594945 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:31.595391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:31.596101 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:31.596596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:31.597017 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:31.658274 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:31.667037 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:31.669100 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:31.670223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-346b1db6-f8cc-47c6-80c1-1a23135f9967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.242707 Aug 23 16:41:31.671905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 240/494] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:31 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:31.828467 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-ff5f4dd6-c292-4565-89dc-b5a23405cd13 req-65e083ec-48fc-4557-a18c-55bb7b70ee82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416120b8-58dd-404a-86bf-6b41b5790ccc", "name": "network-vif-deleted", "tag": "7eee61fd-f595-43a1-bd25-cbec1755a72e"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:31.839190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ff5f4dd6-c292-4565-89dc-b5a23405cd13 req-65e083ec-48fc-4557-a18c-55bb7b70ee82 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:31.839660 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ff5f4dd6-c292-4565-89dc-b5a23405cd13 req-65e083ec-48fc-4557-a18c-55bb7b70ee82 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:31.840187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ff5f4dd6-c292-4565-89dc-b5a23405cd13 req-65e083ec-48fc-4557-a18c-55bb7b70ee82 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:31.840535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:31.852300 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5418042e-a29f-46bb-a1fb-b4b789c7084e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1504 microversion: 2.1 time: 0.270495 Aug 23 16:41:31.853730 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 255/495] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:31 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1504 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:31.854424 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-ff5f4dd6-c292-4565-89dc-b5a23405cd13 req-65e083ec-48fc-4557-a18c-55bb7b70ee82 service nova] Creating event network-vif-deleted:7eee61fd-f595-43a1-bd25-cbec1755a72e for instance 416120b8-58dd-404a-86bf-6b41b5790ccc on hv-cinder-85032 Aug 23 16:41:31.866582 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-ff5f4dd6-c292-4565-89dc-b5a23405cd13 req-65e083ec-48fc-4557-a18c-55bb7b70ee82 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044629 Aug 23 16:41:31.867583 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 241/496] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:41:32.010287 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:32.011424 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:32.018199 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:32.018682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:32.019121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:32.019896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:32.020392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:32.020821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:32.091408 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:32.092456 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] [instance: 60fffd56-ef88-490e-a52d-e7eef91d7b95] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:32.107800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:32.110117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:32.110981 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:32.112149 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:32.112935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:32.113536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:32.128513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] HTTP exception thrown: Instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 could not be found. Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Request method failure captured: Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 HTTP/1.1 Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQLyF1wOWVulE9Q6O-jG58VxQ4hMFGKVQbx3W8QxAFAtPi3HMJJsfISc25CXRaAm6zq-pTmDsqeWfLKWdzBrljzHGtZETVt826QZXUM-ZmDYl-ORsx-zVohYL-7hHgIuzv7xvL3jJ0wBY3h8GFSeqPk7bZjRKT2J-mmD-dF0Zf9RZIM Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 4ebc216b3b834c64b9050e5be8ca1154 Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-VolumesNegativeTest-1612743245 Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:41:32.138166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebc216b3b834c64b9050e5be8ca1154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ebc216b3b834c64b9050e5be8ca1154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ebc216b3b834c64b9050e5be8ca1154", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ebc216b3b834c64b9050e5be8ca1154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-VolumesNegativeTest-1612743245 Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 4ebc216b3b834c64b9050e5be8ca1154 Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-VolumesNegativeTest-1612743245 Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-VolumesNegativeTest-1612743245-project Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 71044fadc41c4a78837c5cfeefb5b858 Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-VolumesNegativeTest-1612743245-project Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 could not be found. Aug 23 16:41:32.140705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '60fffd56-ef88-490e-a52d-e7eef91d7b95'} Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 could not be found. Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:41:32.142108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 could not be found. Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 could not be found. Aug 23 16:41:32.146485 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:41:32.169754 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] Returning 404 to user: Instance 60fffd56-ef88-490e-a52d-e7eef91d7b95 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:41:32.169754 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ea44a39e-bc61-44c8-8648-b07536d4bc06 tempest-VolumesNegativeTest-1612743245 tempest-VolumesNegativeTest-1612743245-project] 10.222.0.52 "GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95" status: 404 len: 111 microversion: 2.1 time: 0.060852 Aug 23 16:41:32.169754 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 242/497] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:32 2022] GET /compute/v2.1/servers/60fffd56-ef88-490e-a52d-e7eef91d7b95 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 16:41:32.201535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:32.202112 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-093d8d9e-7b5d-4856-a79d-d3937f1cfa44 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.195789 Aug 23 16:41:32.202770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 256/498] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:32 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:32.697572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:32.698350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:32.705127 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:32.705791 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:32.706230 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:32.707019 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:32.708064 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:32.708650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:32.884736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:32.885745 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:32.886376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:32.900518 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:32.902578 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:32.904388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:32.905239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:32.908349 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:32.914175 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:32.914392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:32.914392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:32.914558 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8ddfb987-673d-4cc1-b3b0-07e78be5de01 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.217269 Aug 23 16:41:32.914558 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 243/499] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:32 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:32.955016 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:32.955536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:32.956007 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:32.956490 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lazy-loading 'fault' on Instance uuid 416120b8-58dd-404a-86bf-6b41b5790ccc {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:41:33.000871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:33.009711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d7548be7-2922-4e1e-a002-4413e3676541 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 200 len: 1304 microversion: 2.1 time: 0.136257 Aug 23 16:41:33.010300 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 257/500] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:32 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:33.224816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:33.225442 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:33.232136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.232712 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.233139 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:33.233834 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.234279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.234697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:33.377848 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:33.386657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3506a378-f6aa-4cd7-9791-066fcda90c24 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1501 microversion: 2.1 time: 0.166509 Aug 23 16:41:33.387256 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 244/501] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:33 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:33.408386 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbc88dae-19b1-4a74-831a-1937e66f2367"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:33.411365 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:33.413879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:33.418713 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.419208 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.419649 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:33.420379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.420842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.421271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:33.445817 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] HTTP exception thrown: Cannot 'attach_volume' instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 while it is in vm_state rescued Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Request method failure captured: Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: POST /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0/os-volume_attachments HTTP/1.1 Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 74 Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKYblaySY69o3r67kZXBryao_JDz8ISrivQ4koxsrmPtheZvDHuaJfkPKyTtGzAPMTZ0C_nBLI8kFRTmhFlEKYQNhz9rpsAUQn2twU4r9ydG41I-t1EJaMk29PXKgrUhqFvE6UV4XUsrtUpM3-SncpZB3kDhTQxJcVSY8_WbTBR_cM Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:41:33.447535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_102f835e0f424477aab1d540a2a15d22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 50c9a90fabc0466988ed6bae32beb47f Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {"volumeAttachment": {"volumeId": "cbc88dae-19b1-4a74-831a-1937e66f2367"}} Aug 23 16:41:33.456242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Cannot 'attach_volume' instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 while it is in vm_state rescued Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'server_id': 'd6bc7e3a-0456-408f-9de6-b4d4c33413b0', 'body': {'volumeAttachment': {'volumeId': 'cbc88dae-19b1-4a74-831a-1937e66f2367'}}} Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:41:33.457699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 while it is in vm_state rescued Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:41:33.459021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:41:33.461319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:41:33.461319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:41:33.461319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 while it is in vm_state rescued Aug 23 16:41:33.461319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:33.461319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Returning 409 to user: Cannot 'attach_volume' instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 while it is in vm_state rescued {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:41:33.461319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9db84bc9-78a1-4a5b-adab-e8309fe3370a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044889 Aug 23 16:41:33.461319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 258/502] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:41:33 2022] POST /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 16:41:33.465573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-fca248d8-5f0b-48f5-95c7-3d27d69b4cf1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:33.466395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-fca248d8-5f0b-48f5-95c7-3d27d69b4cf1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:33.473884 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fca248d8-5f0b-48f5-95c7-3d27d69b4cf1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.474309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fca248d8-5f0b-48f5-95c7-3d27d69b4cf1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.474740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fca248d8-5f0b-48f5-95c7-3d27d69b4cf1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:33.475456 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fca248d8-5f0b-48f5-95c7-3d27d69b4cf1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.476034 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fca248d8-5f0b-48f5-95c7-3d27d69b4cf1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.476732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fca248d8-5f0b-48f5-95c7-3d27d69b4cf1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:33.481152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:33.758733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-fca248d8-5f0b-48f5-95c7-3d27d69b4cf1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0/action" status: 202 len: 0 microversion: 2.1 time: 0.303925 Aug 23 16:41:33.762557 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 245/503] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:41:33 2022] POST /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:41:33.768010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:33.768788 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:33.776449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.777061 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.777604 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:33.778635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.779340 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.779837 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:33.950681 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:33.951658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:33.959681 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.960673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.961337 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:33.962261 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:33.963077 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:33.963660 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:34.006649 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:34.020812 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d0edbee9-f6cd-4ebc-bea7-267075ba00c2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1509 microversion: 2.1 time: 0.254317 Aug 23 16:41:34.026223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 259/504] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:33 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:34.041172 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:34.052000 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 416120b8-58dd-404a-86bf-6b41b5790ccc] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:34.065502 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:34.071292 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:34.072400 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:34.082539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:34.085045 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:34.086211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:34.110166 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] HTTP exception thrown: Instance 416120b8-58dd-404a-86bf-6b41b5790ccc could not be found. Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Request method failure captured: Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc HTTP/1.1 Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQL33BkN9dBY5ueHrDRvU1TZWSl2aW0gE7u0YHhlZsJS5oQ9sKG-IA7QWb6huzXeAiUoebBl7cmiiAFSgSTjsaxWT0Hl68fflS2jJ4D71zTnKZ7frdsSH7Qrg6Ja5LYpgXmGbjis1d4QTxmeoPdQNsDYF_ou5_NKKSVyfqfFoombqrI Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: e4b82742e5d94428b3397db5e6b6dfd3 Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesActionsTest-1550296046 Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:41:34.127265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4b82742e5d94428b3397db5e6b6dfd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4b82742e5d94428b3397db5e6b6dfd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4b82742e5d94428b3397db5e6b6dfd3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4b82742e5d94428b3397db5e6b6dfd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesActionsTest-1550296046 Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: e4b82742e5d94428b3397db5e6b6dfd3 Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesActionsTest-1550296046 Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesActionsTest-1550296046-project Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: b8a23dda6cf24ee6a6c73cd1d6189dca Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesActionsTest-1550296046-project Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 416120b8-58dd-404a-86bf-6b41b5790ccc could not be found. Aug 23 16:41:34.129500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '416120b8-58dd-404a-86bf-6b41b5790ccc'} Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416120b8-58dd-404a-86bf-6b41b5790ccc could not be found. Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:41:34.130432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416120b8-58dd-404a-86bf-6b41b5790ccc could not be found. Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416120b8-58dd-404a-86bf-6b41b5790ccc could not be found. Aug 23 16:41:34.132191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:41:34.133546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Returning 404 to user: Instance 416120b8-58dd-404a-86bf-6b41b5790ccc could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:41:34.133546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1baf1da9-1366-4122-8da3-ddbdf9412eba tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc" status: 404 len: 111 microversion: 2.1 time: 0.093050 Aug 23 16:41:34.133546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 260/505] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:34 2022] GET /compute/v2.1/servers/416120b8-58dd-404a-86bf-6b41b5790ccc => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:41:34.159977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-c4974fa8-0617-49d8-80c1-611bff405749 req-376789ae-5030-4d63-a30a-301fec62208f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8", "name": "network-vif-plugged", "status": "completed", "tag": "e24378e6-7626-4b59-81eb-752fbcca503a"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:34.172698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-c4974fa8-0617-49d8-80c1-611bff405749 req-376789ae-5030-4d63-a30a-301fec62208f service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:34.173488 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-c4974fa8-0617-49d8-80c1-611bff405749 req-376789ae-5030-4d63-a30a-301fec62208f service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:34.174093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-c4974fa8-0617-49d8-80c1-611bff405749 req-376789ae-5030-4d63-a30a-301fec62208f service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:34.189764 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-c4974fa8-0617-49d8-80c1-611bff405749 req-376789ae-5030-4d63-a30a-301fec62208f service nova] Creating event network-vif-plugged:e24378e6-7626-4b59-81eb-752fbcca503a for instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 on hv-cinder-85032 Aug 23 16:41:34.198089 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-c4974fa8-0617-49d8-80c1-611bff405749 req-376789ae-5030-4d63-a30a-301fec62208f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058846 Aug 23 16:41:34.200132 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 261/506] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:41:34.278212 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:34.288530 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:34.291653 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:34.293088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-aa692150-f32e-4431-8d54-e074af52fae8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.347452 Aug 23 16:41:34.294715 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 246/507] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:33 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:34.375986 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1230652550", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "networks": [{"uuid": "9dfacecf-9308-4f0e-92e3-c466f669021e"}]}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:34.484348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] validate_networks() for [('9dfacecf-9308-4f0e-92e3-c466f669021e', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:41:35.049968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:35.051766 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:35.059878 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:35.061057 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:35.061725 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:35.062944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:35.063620 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:35.064400 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:35.119915 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:41:35.120532 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:41:35.120855 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:41:35.121248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:41:35.121662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:41:35.131507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:35.131992 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:35.132466 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:35.133205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:35.133662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:35.134093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:35.152910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Getting quotas for project e4b82742e5d94428b3397db5e6b6dfd3. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:41:35.157296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Getting quotas for user b8a23dda6cf24ee6a6c73cd1d6189dca and project e4b82742e5d94428b3397db5e6b6dfd3. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:41:35.175275 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:41:35.175275 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:41:35.228838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:35.236865 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6539f659-4072-4540-8657-10b60480bd54 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1509 microversion: 2.1 time: 0.190742 Aug 23 16:41:35.237462 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 247/508] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:35 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:35.317022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:35.317637 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:35.324105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:35.324644 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:35.325076 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:35.325793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:35.326254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:35.326703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:35.351722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f4242825-1bf3-4ea2-91cc-e1ee7aa3b477 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991976 Aug 23 16:41:35.352969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 262/509] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:41:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:41:35.367357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7768af03-c292-48e6-bb71-df4d5b8af3ce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:35.368446 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7768af03-c292-48e6-bb71-df4d5b8af3ce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:35.477760 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7768af03-c292-48e6-bb71-df4d5b8af3ce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:35.490297 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7768af03-c292-48e6-bb71-df4d5b8af3ce tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1214 microversion: 2.1 time: 0.128126 Aug 23 16:41:35.491222 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 263/510] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:35 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:35.568723 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:35.568723 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:35.569092 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:35.570009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2a97e6b6-0798-47b6-875f-98564df7d77e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.258469 Aug 23 16:41:35.570569 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 248/511] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:35 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:36.257151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:36.257841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:36.264516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:36.265006 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:36.265445 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:36.266150 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:36.266610 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:36.267043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:36.409379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:36.417527 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-60c42da9-bdd6-4128-8d1e-e27476ada5d1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1509 microversion: 2.1 time: 0.164249 Aug 23 16:41:36.418095 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 264/512] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:36 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:36.510833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:36.511442 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:36.518386 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:36.518875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:36.519311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:36.520193 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:36.520812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:36.521389 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:36.583035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:36.592332 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-415b705b-4753-4825-a5a6-dd0a80e1b3de tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1218 microversion: 2.1 time: 0.085229 Aug 23 16:41:36.593088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 249/513] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:36 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:36.593581 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:36.594927 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:36.601865 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:36.602698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:36.603211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:36.603979 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:36.604539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:36.605039 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:36.743994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:36.752901 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:36.754406 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:36.755514 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-aac5ccc7-80c9-4a52-b8d3-ae17a9b2c565 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.166250 Aug 23 16:41:36.756066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 265/514] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:36 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:41:37.438935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:37.439564 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:37.446342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:37.446818 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:37.447245 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:37.447923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:37.448390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:37.448807 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:37.591351 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:37.599812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-fc002e84-41cc-4bf7-86a4-395cce4cf6f8 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1509 microversion: 2.1 time: 0.164644 Aug 23 16:41:37.600504 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 250/515] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:37 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:37.614255 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:37.615383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:37.622371 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:37.622894 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:37.623340 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:37.624035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:37.624527 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:37.624954 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:37.694840 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:37.704788 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0eb446a4-7eda-45a5-b9d0-203800494ca1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1218 microversion: 2.1 time: 0.094980 Aug 23 16:41:37.705553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 266/516] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:37 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:37.782165 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:37.782855 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:37.790143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:37.793755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:37.793755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:37.793755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:37.793755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:37.794179 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:37.946675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:37.954937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:37.956444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:37.957634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e2442a84-1391-4c15-8968-37a742f1b9be tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1407 microversion: 2.20 time: 0.180105 Aug 23 16:41:37.958177 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 251/517] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:37 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:38.622527 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:38.623073 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:38.629939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:38.630421 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:38.630861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:38.631556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:38.632010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:38.632456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:38.725772 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:38.726547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:38.736038 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:38.736559 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:38.736991 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:38.737694 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:38.738144 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:38.738565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:38.813259 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:38.824074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f4b243cc-c382-465f-9513-ec713635c37c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1509 microversion: 2.1 time: 0.205244 Aug 23 16:41:38.824787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 267/518] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:38 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:38.832717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:38.841880 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3862fe68-392a-4288-b45c-2f8d2c16554a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1218 microversion: 2.1 time: 0.119878 Aug 23 16:41:38.842596 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 252/519] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:38 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:38.979325 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:38.979940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:38.986183 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:38.987359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:38.987815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:38.989052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:38.989519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:38.989947 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:39.129847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:39.138379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:39.139960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:39.141241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-29c418c5-922f-41b2-987c-0f913f060474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1598 microversion: 2.20 time: 0.166150 Aug 23 16:41:39.142157 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 268/520] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:41:38 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1598 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:41:39.165557 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3ecdc38d-26b8-4612-8e84-2ee23b45c044 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:39.166184 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3ecdc38d-26b8-4612-8e84-2ee23b45c044 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:39.172965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3ecdc38d-26b8-4612-8e84-2ee23b45c044 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:39.173448 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3ecdc38d-26b8-4612-8e84-2ee23b45c044 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:39.173880 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3ecdc38d-26b8-4612-8e84-2ee23b45c044 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:39.174562 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3ecdc38d-26b8-4612-8e84-2ee23b45c044 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:39.175006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3ecdc38d-26b8-4612-8e84-2ee23b45c044 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:39.175423 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3ecdc38d-26b8-4612-8e84-2ee23b45c044 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:39.253121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3ecdc38d-26b8-4612-8e84-2ee23b45c044 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091497 Aug 23 16:41:39.253717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 253/521] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Aug 23 16:41:39 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:41:39.846553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:39.847033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:39.857056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:39.857056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:39.857056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:39.859782 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:39.860352 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:39.861053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:39.863057 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:39.863828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:39.875218 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:39.876004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:39.876614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:39.878626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:39.884357 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:39.888530 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:39.996276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:40.006408 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-fc5c1687-4162-47e1-a343-2cfa79aaa925 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1218 microversion: 2.1 time: 0.147645 Aug 23 16:41:40.007130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 254/522] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:39 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:40.104114 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:40.116331 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3c8bfd37-8d1e-4651-9bd8-8eead5900d27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1515 microversion: 2.1 time: 0.272361 Aug 23 16:41:40.117149 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 269/523] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:39 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1515 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:41.072650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-112094db-a690-418f-84f5-ccd8865e8cd1 req-88a670f0-884f-4ebd-9b5c-1ba59fe1135e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8", "tag": "e24378e6-7626-4b59-81eb-752fbcca503a"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:41.072650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-112094db-a690-418f-84f5-ccd8865e8cd1 req-88a670f0-884f-4ebd-9b5c-1ba59fe1135e service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:41.072650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-112094db-a690-418f-84f5-ccd8865e8cd1 req-88a670f0-884f-4ebd-9b5c-1ba59fe1135e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:41.072650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-112094db-a690-418f-84f5-ccd8865e8cd1 req-88a670f0-884f-4ebd-9b5c-1ba59fe1135e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:41.074146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-112094db-a690-418f-84f5-ccd8865e8cd1 req-88a670f0-884f-4ebd-9b5c-1ba59fe1135e service nova] Creating event network-changed:e24378e6-7626-4b59-81eb-752fbcca503a for instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 on hv-cinder-85032 Aug 23 16:41:41.074146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-112094db-a690-418f-84f5-ccd8865e8cd1 req-88a670f0-884f-4ebd-9b5c-1ba59fe1135e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049709 Aug 23 16:41:41.074146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 255/524] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:41:41.074909 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:41.074909 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:41.074909 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:41.074909 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:41.075736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:41.075736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:41.075736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:41.075736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:41.112977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:41.125075 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ee4db2de-837e-46f0-83c6-c317a5cff3f9 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1210 microversion: 2.1 time: 0.101954 Aug 23 16:41:41.126142 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 270/525] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:41 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:42.150915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:42.151928 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:42.160356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:42.162323 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:42.162916 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:42.163542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:42.164042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:42.165365 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:42.317419 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:42.329952 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4e95ae50-e161-4ec2-9742-d15658fdb14a tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1266 microversion: 2.1 time: 0.184232 Aug 23 16:41:42.339780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 256/526] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:42 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:43.353122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2d8a043e-878d-4a44-9d59-0cf3bb27f781 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'create', calling method: .version_select at 0x7f67782290d0>, body: {"keypair": {"name": "tempest-keypair-294827385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFllTm9GtbKZJ9h9u9/ACjcd5p+dm01pkGnqifWNhbTdl1cyi94krfHDp8rnlBnJgkOTi8b35lvEP35ggBb9Qmy9oqvmGXrWuqD00SQJjexZKEUicmwwydFwHm2RJXzY7g=="}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:43.364951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:43.366347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:43.372147 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-2d8a043e-878d-4a44-9d59-0cf3bb27f781 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Getting quotas for project 102f835e0f424477aab1d540a2a15d22. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:41:43.373080 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:43.373572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:43.374136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:43.375152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:43.376032 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:43.376646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:43.385117 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-2d8a043e-878d-4a44-9d59-0cf3bb27f781 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Getting quotas for user 50c9a90fabc0466988ed6bae32beb47f and project 102f835e0f424477aab1d540a2a15d22. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:41:43.398661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2d8a043e-878d-4a44-9d59-0cf3bb27f781 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [11cc7970-bb48-4915-a256-d9e6379c6505] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 16:41:43.523230 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:43.531728 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d803cf7b-29a6-4ff3-a77a-249aca518eac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.171550 Aug 23 16:41:43.532357 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 257/527] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:43 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:44.369367 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-216e58d2-8123-4282-9c1a-520ba6757288 req-3828856b-8502-4739-b8ba-50014b3b7231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a509a04-13ef-4eb9-8a65-ae4a3f605742", "tag": "53cae68c-bdbe-4755-9367-4dbc50a625ea"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:44.379742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-216e58d2-8123-4282-9c1a-520ba6757288 req-3828856b-8502-4739-b8ba-50014b3b7231 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:44.381992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-216e58d2-8123-4282-9c1a-520ba6757288 req-3828856b-8502-4739-b8ba-50014b3b7231 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:44.381992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-216e58d2-8123-4282-9c1a-520ba6757288 req-3828856b-8502-4739-b8ba-50014b3b7231 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:44.393306 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-216e58d2-8123-4282-9c1a-520ba6757288 req-3828856b-8502-4739-b8ba-50014b3b7231 service nova] Creating event network-changed:53cae68c-bdbe-4755-9367-4dbc50a625ea for instance 1a509a04-13ef-4eb9-8a65-ae4a3f605742 on hv-cinder-85032 Aug 23 16:41:44.397949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-216e58d2-8123-4282-9c1a-520ba6757288 req-3828856b-8502-4739-b8ba-50014b3b7231 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032256 Aug 23 16:41:44.398542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 258/528] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:41:44.406193 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [None req-2d8a043e-878d-4a44-9d59-0cf3bb27f781 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [11cc7970-bb48-4915-a256-d9e6379c6505] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48130. Aug 23 16:41:44.499483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2d8a043e-878d-4a44-9d59-0cf3bb27f781 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.150440 Aug 23 16:41:44.500098 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 271/529] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:41:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:41:44.559282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:44.560017 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:44.566419 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:44.566908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:44.567344 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:44.568079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:44.568589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:44.569067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:44.757336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:44.765378 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a63a183b-e20f-44b8-a13a-b3e11e14801d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.210346 Aug 23 16:41:44.765967 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 259/530] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:44 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:45.786036 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:45.786581 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:45.788639 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:45.794686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:45.795178 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:45.795619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:45.796351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:45.796812 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:45.797244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:46.198064 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:46.205932 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9a0aa1fe-eb08-4510-bbff-55290befdac4 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.424524 Aug 23 16:41:46.206519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 272/531] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:45 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:47.228067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:47.228760 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:47.235635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:47.236130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:47.236600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:47.237305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:47.237761 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:47.238187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:47.475538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:47.486575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-87806248-5d0e-4b8e-831e-226d3ba946e7 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.262628 Aug 23 16:41:47.487155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 260/532] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:47 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:47.667319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1098956461", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "958e307a-9cd7-4eba-9cf6-b241bcc41dcd"}], "security_groups": [{"name": "tempest-securitygroup--1983786326"}], "key_name": "tempest-keypair-294827385", "user_data": "}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:41:47.786094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] validate_networks() for [('958e307a-9cd7-4eba-9cf6-b241bcc41dcd', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:41:48.283491 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:41:48.284157 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:41:48.285276 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:41:48.285810 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:41:48.286455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:41:48.298159 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:48.298796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:48.299455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:48.301040 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:48.301623 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:48.302164 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:48.321118 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Getting quotas for project 102f835e0f424477aab1d540a2a15d22. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:41:48.325340 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Getting quotas for user 50c9a90fabc0466988ed6bae32beb47f and project 102f835e0f424477aab1d540a2a15d22. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:41:48.340847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:41:48.345198 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:41:48.507786 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:48.508513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:48.515428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:48.515984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:48.516555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:48.517325 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:48.517843 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:48.518353 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:48.615457 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c298d65a-2e1b-48e2-9cfc-19d372caeafe tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.952416 Aug 23 16:41:48.618946 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 273/533] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:41:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:41:48.635527 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-904f8978-a106-42e2-858f-82f44793bb43 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:48.636631 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-904f8978-a106-42e2-858f-82f44793bb43 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:48.692516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:48.701083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-63d762c1-e5ae-4f78-8fe4-73249db191d0 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.197216 Aug 23 16:41:48.703081 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 261/534] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:48 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:48.729132 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-904f8978-a106-42e2-858f-82f44793bb43 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:48.738326 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-904f8978-a106-42e2-858f-82f44793bb43 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1245 microversion: 2.1 time: 0.108013 Aug 23 16:41:48.740205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 274/535] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:48 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1245 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:49.723622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:49.724271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:49.731175 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:49.731651 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:49.732118 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:49.732906 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:49.733285 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:49.733710 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:49.752542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:49.760714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6c15b591-275f-4171-8b1a-eb47da6ffaa2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:49.761516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6c15b591-275f-4171-8b1a-eb47da6ffaa2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:49.835430 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6c15b591-275f-4171-8b1a-eb47da6ffaa2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:49.842689 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6c15b591-275f-4171-8b1a-eb47da6ffaa2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1245 microversion: 2.1 time: 0.085951 Aug 23 16:41:49.843471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 275/536] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:49 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:49.898810 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:49.906711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d18ae309-e860-486a-b0ea-d99f5ac6736f tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.187573 Aug 23 16:41:49.907372 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 262/537] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:49 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:50.867310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:50.867893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:50.875859 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:50.876451 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:50.876891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:50.877755 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:50.878213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:50.879345 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:50.931539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:50.932312 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:50.940028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:50.940609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:50.941702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:50.942478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:50.943076 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:50.943503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:50.951288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:50.973617 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-44ef515c-8b68-41d8-b0dd-5bc0e31a3239 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1249 microversion: 2.1 time: 0.096832 Aug 23 16:41:50.973617 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 276/538] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:50 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:51.086744 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:51.094890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9b29ccc1-7245-4023-bed3-d70b9d9af22e tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.168195 Aug 23 16:41:51.095538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 263/539] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:50 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:41:51.987934 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:51.988575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:51.995240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:51.997594 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:51.997594 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:51.997594 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:51.997594 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:51.997935 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:52.065563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:52.074275 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bd544372-c382-45fe-a9c1-f515de0b1e2f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1249 microversion: 2.1 time: 0.090308 Aug 23 16:41:52.087439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 277/540] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:51 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:52.116699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:52.117377 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:52.124383 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:52.124874 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:52.125314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:52.126019 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:52.126470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:52.126895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:52.266434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:52.274847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f5ee8c4f-2225-479c-8735-cc9cec9a3175 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.162503 Aug 23 16:41:52.275436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 264/541] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:52 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:53.095796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:53.096429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:53.103822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:53.104420 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:53.104870 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:53.105566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:53.106027 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:53.106461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:53.110468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:53.168126 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:53.175664 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-277b1e80-8266-43a6-b47f-a6fddf763416 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1249 microversion: 2.1 time: 0.083700 Aug 23 16:41:53.176243 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 278/542] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:53 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:53.296080 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:53.296746 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:53.303943 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:53.304449 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:53.304893 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:53.305619 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:53.306105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:53.306531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:53.454593 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:53.467317 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-611b735d-b704-455b-9d25-6356afa16393 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.174982 Aug 23 16:41:53.468337 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 265/543] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:53 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:54.196720 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:54.197511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:54.203847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:54.204369 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:54.204819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:54.205536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:54.205997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:54.206462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:54.269388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:54.277002 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c574ef64-c58c-43dd-b115-138b673107ab tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1249 microversion: 2.1 time: 0.084734 Aug 23 16:41:54.277576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 279/544] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:54 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:54.490169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:54.490741 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:54.497093 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:54.497541 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:54.497972 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:54.498672 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:54.499147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:54.499565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:54.643689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:54.652269 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-519fa798-8b59-41c2-ac76-06b3cd0e7dc2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.166810 Aug 23 16:41:54.652849 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 266/545] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:54 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:55.298066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:55.298683 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:55.304880 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:55.305386 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:55.305828 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:55.306569 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:55.307013 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:55.307440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:55.380879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:55.388869 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ca345cb6-d7bb-4108-9292-b12b73600f70 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1249 microversion: 2.1 time: 0.094742 Aug 23 16:41:55.389460 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 280/546] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:55 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:55.683508 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:55.684749 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:55.687373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:55.692964 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:55.693457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:55.693914 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:55.694620 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:55.695078 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:55.695508 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:55.851610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:55.862057 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-baf0a6ff-599a-489f-a703-1062352920d1 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.182046 Aug 23 16:41:55.863366 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 267/547] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:55 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:56.409824 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:56.410434 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:56.416871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:56.417351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:56.417785 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:56.418475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:56.418926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:56.419351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:56.482862 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:56.491620 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4645299a-3387-412c-a35f-3965b29e6d0f tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1249 microversion: 2.1 time: 0.085567 Aug 23 16:41:56.497117 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 281/548] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:56 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:56.889819 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:56.891040 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:56.903772 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:56.907388 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:56.908629 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:56.910468 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:56.911308 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:56.912060 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:57.108538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:57.117189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9cc2c7cf-1237-4fdc-ac5c-c66e213da006 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.235038 Aug 23 16:41:57.121377 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 268/549] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:56 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:57.513606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:57.514309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:57.523131 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:57.523584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:57.524033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:57.524798 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:57.525262 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:57.525695 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:57.609687 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:57.623201 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-12fbdb02-a268-4b20-b764-e24e5c74156b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1297 microversion: 2.1 time: 0.112712 Aug 23 16:41:57.623316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 282/550] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:57 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1297 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:58.140206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:58.141280 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:58.151639 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:58.152311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:58.152827 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:58.153695 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:58.154322 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:58.154957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:58.304858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:58.312985 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1761812c-1101-4726-ac6f-06133fbcca58 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.177753 Aug 23 16:41:58.313593 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 269/551] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:58 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:58.649666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:58.650361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:58.652387 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:58.658119 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:58.658952 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:58.659402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:58.660211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:58.660619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:58.661148 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:58.734645 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:58.744141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ca6d94f0-d78d-437d-ad58-32bdd70c91f7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1305 microversion: 2.1 time: 0.102440 Aug 23 16:41:58.744751 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 283/552] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:58 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:59.335194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:59.335816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:59.342432 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:59.342907 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:59.343340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:59.344030 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:59.344532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:59.344954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:59.481780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:59.490384 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5fb3d3de-7cca-4138-ad79-e7d5b9744353 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.159647 Aug 23 16:41:59.494401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 270/553] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:59 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:41:59.765730 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:41:59.766306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:41:59.773460 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:59.773943 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:59.774382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:59.775066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:41:59.775519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:41:59.775938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:41:59.841817 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=22 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:41:59.854978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:41:59.867355 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b54d8253-a9eb-4428-bd49-408891489b4d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1315 microversion: 2.1 time: 0.104976 Aug 23 16:41:59.868546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 284/554] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:41:59 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1315 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:00.511158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:00.511767 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:00.525124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:00.525124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:00.525124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:00.525124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:00.525465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:00.525465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:00.671416 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:00.679302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-33cc9396-e57f-441e-845c-9c30fd342e73 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.172287 Aug 23 16:42:00.679993 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 271/555] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:00 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:00.894281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:00.894876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:00.897288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:00.902069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:00.902589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:00.903026 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:00.903721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:00.904193 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:00.904608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:00.976825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:00.985141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5fe2f3ad-8f18-407e-958e-9dfa2363d235 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1315 microversion: 2.1 time: 0.095581 Aug 23 16:42:00.985733 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 285/556] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:00 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1315 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:01.700110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:01.700831 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:01.707386 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:01.708115 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:01.708586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:01.709292 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:01.709751 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:01.710174 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:01.855652 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:01.865779 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-45aa0501-0b17-4b8f-8747-eddc52f093eb tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.169510 Aug 23 16:42:01.866367 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 272/557] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:01 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:02.006930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:02.007855 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:02.017023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:02.017023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:02.017023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:02.017023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:02.017396 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:02.017396 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:02.087657 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:02.095566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-edcbfc63-15fa-4dc0-b73f-fcf83ab70c71 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1315 microversion: 2.1 time: 0.092779 Aug 23 16:42:02.096176 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 286/558] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:02 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1315 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:02.892629 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:02.893705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:02.901653 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:02.902931 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:02.902931 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:02.903688 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:02.904301 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:02.904839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:03.069523 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:03.077852 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0e61a45c-35e9-48af-8222-44746560637d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.193641 Aug 23 16:42:03.078420 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 273/559] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:02 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:03.118187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:03.118824 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:03.125819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:03.126313 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:03.126752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:03.127468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:03.128011 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:03.128962 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:03.337051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:03.354692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6d44542e-e033-4880-917c-2bb4c9e558b2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.239870 Aug 23 16:42:03.355834 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 287/560] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:03 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:04.103374 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:04.104509 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:04.115351 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:04.116152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:04.116812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:04.117662 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:04.118237 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:04.118895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:04.278875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:04.287390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-da4d0864-32e7-42ba-865d-b156ebdf325d tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.189014 Aug 23 16:42:04.287995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 274/561] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:04 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:04.375407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-d8085602-18c0-4fbb-9be0-73dfcdacb7d0 req-837349e0-75c3-44f5-bcc3-49e27cc55cba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de441a4-ffc5-43ff-bf83-faec28f6ed1f", "tag": "a6f566e4-5cdd-45cb-b319-5370499e6059"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:04.387383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-d8085602-18c0-4fbb-9be0-73dfcdacb7d0 req-837349e0-75c3-44f5-bcc3-49e27cc55cba service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:04.390825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-d8085602-18c0-4fbb-9be0-73dfcdacb7d0 req-837349e0-75c3-44f5-bcc3-49e27cc55cba service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:04.390825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-d8085602-18c0-4fbb-9be0-73dfcdacb7d0 req-837349e0-75c3-44f5-bcc3-49e27cc55cba service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:04.391039 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:04.391039 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:04.397748 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:04.398455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:04.399270 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:04.400119 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:04.400673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:04.401183 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:04.405795 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-d8085602-18c0-4fbb-9be0-73dfcdacb7d0 req-837349e0-75c3-44f5-bcc3-49e27cc55cba service nova] Creating event network-changed:a6f566e4-5cdd-45cb-b319-5370499e6059 for instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f on hv-cinder-85032 Aug 23 16:42:04.411127 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-d8085602-18c0-4fbb-9be0-73dfcdacb7d0 req-837349e0-75c3-44f5-bcc3-49e27cc55cba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039471 Aug 23 16:42:04.412205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 288/562] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:04.561468 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:04.571446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-97b04c72-4a4f-425e-bf96-cd99fd0a0e15 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.198253 Aug 23 16:42:04.572460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 275/563] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:04 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:05.308283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:05.309025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:05.315204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:05.315694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:05.316139 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:05.316875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:05.317380 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:05.317813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:05.481130 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:05.489023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5c80cb65-18df-4e2d-a648-aa4cb1033012 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.184950 Aug 23 16:42:05.489610 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 289/564] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:05 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:05.597129 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:05.597744 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:05.604785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:05.605289 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:05.605862 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:05.606109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-0aaff9f9-419a-4429-902b-592709cbde9b req-0c96b51e-cfb1-4279-bf37-5c976f481680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a509a04-13ef-4eb9-8a65-ae4a3f605742", "name": "network-vif-plugged", "status": "completed", "tag": "53cae68c-bdbe-4755-9367-4dbc50a625ea"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:05.606658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:05.607117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:05.607555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:05.615870 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-0aaff9f9-419a-4429-902b-592709cbde9b req-0c96b51e-cfb1-4279-bf37-5c976f481680 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:05.616100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-0aaff9f9-419a-4429-902b-592709cbde9b req-0c96b51e-cfb1-4279-bf37-5c976f481680 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:05.616592 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-0aaff9f9-419a-4429-902b-592709cbde9b req-0c96b51e-cfb1-4279-bf37-5c976f481680 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:05.633202 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-0aaff9f9-419a-4429-902b-592709cbde9b req-0c96b51e-cfb1-4279-bf37-5c976f481680 service nova] Creating event network-vif-plugged:53cae68c-bdbe-4755-9367-4dbc50a625ea for instance 1a509a04-13ef-4eb9-8a65-ae4a3f605742 on hv-cinder-85032 Aug 23 16:42:05.639564 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-0aaff9f9-419a-4429-902b-592709cbde9b req-0c96b51e-cfb1-4279-bf37-5c976f481680 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037149 Aug 23 16:42:05.640471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 290/565] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:05.752620 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:05.761806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-65f8bfbf-c357-4091-9fbf-3dd716068918 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.173619 Aug 23 16:42:05.762340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 276/566] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:05 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:06.512355 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:06.513164 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:06.519879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:06.520300 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:06.520740 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:06.521445 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:06.521893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:06.522483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:06.684113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:06.693105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a5710b51-af8d-4ba0-81cb-fc1feb5e4590 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.185630 Aug 23 16:42:06.693691 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 291/567] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:06 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:06.783634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:06.784993 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:06.791782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:06.792334 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:06.792769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:06.793460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:06.793910 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:06.794333 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:06.938787 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:06.948194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1eeb0d08-baa9-4126-9c93-1e12835c524e tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.168437 Aug 23 16:42:06.948804 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 277/568] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:06 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:07.331081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:07.332220 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:07.338447 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:07.338930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:07.339370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:07.340077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:07.340621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:07.341056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:07.477668 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lazy-loading 'services' on Instance uuid d1ce2e0d-564c-4b98-b0a5-416658f5968b {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:42:07.715330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:07.716309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:07.723338 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:07.723833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:07.727454 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:07.727454 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:07.727454 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:07.727454 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:07.870997 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:07.879062 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b22bbe39-2fa1-487e-8f0c-78ad87554e4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.167955 Aug 23 16:42:07.879631 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 278/569] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:07 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:07.970737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:07.971352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:07.979395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:07.979960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:07.980490 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:07.981290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:07.981782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:07.982322 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:07.987027 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:08.092396 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e1c5b8cb-122c-4f34-a234-f5f3d922a374 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b/os-volume_attachments/59e0dd63-1122-425c-96ca-b2029509ef14" status: 202 len: 0 microversion: 2.1 time: 0.765072 Aug 23 16:42:08.114324 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 292/570] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:42:07 2022] DELETE /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b/os-volume_attachments/59e0dd63-1122-425c-96ca-b2029509ef14 => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 16:42:08.132028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:08.140555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e077eb5f-e0fb-4b0c-8735-81c3f7019ad1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.173601 Aug 23 16:42:08.141138 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 279/571] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:07 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:08.903458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:08.904253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:08.910781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:08.911332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:08.911776 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:08.912571 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:08.913030 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:08.913464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:09.075235 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:09.083431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-aab54bb1-943a-49a5-8d72-d975142e6d4b tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.185179 Aug 23 16:42:09.084008 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 293/572] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:08 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:09.162534 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:09.163274 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:09.171138 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:09.171627 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:09.172059 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:09.172794 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:09.173242 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:09.173664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:09.319384 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:09.327428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-de5e601b-1a86-41aa-835f-48718be76418 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.169336 Aug 23 16:42:09.327945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 280/573] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:09 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:10.103950 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:10.104809 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:10.111338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:10.111833 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:10.112329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:10.113042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:10.113458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:10.113884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:10.251117 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:10.261085 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1e728995-804a-431a-bafb-734e8523db9c tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.161169 Aug 23 16:42:10.261657 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 294/574] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:10 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:10.312042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:10.312617 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:10.319678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:10.320267 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:10.325345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:10.325345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:10.325345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:10.325345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:10.348770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:10.349440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:10.352059 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:42:10.357227 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:10.357867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:10.358312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:10.359035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:10.359739 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:10.360184 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:10.380356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:10.494939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:10.502667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-581a2bc7-7a7e-428a-a00f-1bec7149a70d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.157908 Aug 23 16:42:10.503887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 295/575] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:10 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:10.723572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8e64012a-add4-486b-b4bd-eb59aacef227 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 204 len: 0 microversion: 2.1 time: 0.415390 Aug 23 16:42:10.724306 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 281/576] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:42:10 2022] DELETE /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:42:10.733247 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:10.733879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:10.740865 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:10.741486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:10.741991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:10.742724 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:10.743187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:10.743620 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:10.886280 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:10.894854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-66ee51e2-da26-4c9f-997f-ab9288266583 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1514 microversion: 2.1 time: 0.165811 Aug 23 16:42:10.895750 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 296/577] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:10 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:11.283554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:11.284878 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:11.290828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:11.291314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:11.291753 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:11.292484 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:11.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:11.293362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:11.432264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:11.442263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ec1db106-8dc1-4f8a-be91-6ef264fa3405 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.163135 Aug 23 16:42:11.442943 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 282/578] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:11 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:11.525391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:11.526053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:11.532779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:11.533270 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:11.533710 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:11.534467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:11.535109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:11.535550 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:11.684281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:11.684281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1d36a6b1-a9a4-4e1c-bae9-fc17cd0ef9d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.156559 Aug 23 16:42:11.684281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 297/579] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:11 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:11.917548 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:11.918149 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:11.924447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:11.925482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:11.925908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:11.926615 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:11.927071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:11.927495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:12.059580 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:12.068066 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d05ac103-e5aa-4b28-a8da-719d950af3eb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1514 microversion: 2.1 time: 0.154984 Aug 23 16:42:12.068765 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 283/580] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:11 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:12.464050 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:12.464676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:12.471009 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:12.472087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:12.472744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:12.473473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:12.473934 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:12.474370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:12.650012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:12.658444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-de8262ec-c876-4f48-9c4c-fbe1de9aa459 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1314 microversion: 2.1 time: 0.198862 Aug 23 16:42:12.659072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 298/581] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:12 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:12.698810 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:12.699464 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:12.706634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:12.707113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:12.707549 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:12.708272 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:12.708733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:12.709156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:12.844258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:12.851977 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5a1de115-ce70-462e-afe4-f64c5efd4675 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.157030 Aug 23 16:42:12.852575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 284/582] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:12 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:13.094278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:13.095446 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:13.102353 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:13.102811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:13.103439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:13.104138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:13.104626 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:13.105052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:13.242455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:13.250384 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-33c6da46-19c5-434d-b856-bd50e778645f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1514 microversion: 2.1 time: 0.161758 Aug 23 16:42:13.250951 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 299/583] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:13 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:13.684289 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:13.685514 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:13.696592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:13.697294 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:13.698181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:13.699043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:13.699980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:13.700607 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:13.880815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:13.883008 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:13.892420 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:13.894046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:13.895433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:13.897524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:13.898840 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:13.899439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:13.915756 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:13.924520 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-93965d2a-bc03-4463-a9c4-6f01d607eb43 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1499 microversion: 2.1 time: 0.248000 Aug 23 16:42:13.943812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 285/584] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:13 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1499 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:14.083303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:14.097938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-88ca7289-863d-4f58-b0a4-da742b4b8eef tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.226259 Aug 23 16:42:14.102480 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 300/585] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:13 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:14.271491 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:14.272244 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:14.278600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:14.279088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:14.279526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:14.280295 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:14.280740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:14.281334 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:14.321952 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-46d6adfb-dd69-45ee-90bd-7bfe7b87c13a req-3dfa88e8-8a53-4494-b8c1-ecdc646547c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de441a4-ffc5-43ff-bf83-faec28f6ed1f", "name": "network-vif-plugged", "status": "completed", "tag": "a6f566e4-5cdd-45cb-b319-5370499e6059"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:14.343238 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-46d6adfb-dd69-45ee-90bd-7bfe7b87c13a req-3dfa88e8-8a53-4494-b8c1-ecdc646547c5 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:14.343628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-46d6adfb-dd69-45ee-90bd-7bfe7b87c13a req-3dfa88e8-8a53-4494-b8c1-ecdc646547c5 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:14.344061 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-46d6adfb-dd69-45ee-90bd-7bfe7b87c13a req-3dfa88e8-8a53-4494-b8c1-ecdc646547c5 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:14.348391 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:14.363603 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-46d6adfb-dd69-45ee-90bd-7bfe7b87c13a req-3dfa88e8-8a53-4494-b8c1-ecdc646547c5 service nova] Creating event network-vif-plugged:a6f566e4-5cdd-45cb-b319-5370499e6059 for instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f on hv-cinder-85032 Aug 23 16:42:14.371111 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-46d6adfb-dd69-45ee-90bd-7bfe7b87c13a req-3dfa88e8-8a53-4494-b8c1-ecdc646547c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051836 Aug 23 16:42:14.372427 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 301/586] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:42:14.398226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2d5b6588-f9dd-450e-8145-69ddae38ee33 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1472 microversion: 2.1 time: 0.125374 Aug 23 16:42:14.398226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 286/587] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:14 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1472 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:14.493209 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-92f3f56b-3d18-4d7a-ac2e-171d1876c4dc req-04662355-0bbf-44f3-a818-f2f4eeba8bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ce2e0d-564c-4b98-b0a5-416658f5968b", "name": "network-vif-deleted", "tag": "5cdbf042-8797-4daf-8e46-c209712ca749"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:14.508033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-92f3f56b-3d18-4d7a-ac2e-171d1876c4dc req-04662355-0bbf-44f3-a818-f2f4eeba8bbf service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:14.508542 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-92f3f56b-3d18-4d7a-ac2e-171d1876c4dc req-04662355-0bbf-44f3-a818-f2f4eeba8bbf service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:14.509414 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-92f3f56b-3d18-4d7a-ac2e-171d1876c4dc req-04662355-0bbf-44f3-a818-f2f4eeba8bbf service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:14.524081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-92f3f56b-3d18-4d7a-ac2e-171d1876c4dc req-04662355-0bbf-44f3-a818-f2f4eeba8bbf service nova] Creating event network-vif-deleted:5cdbf042-8797-4daf-8e46-c209712ca749 for instance d1ce2e0d-564c-4b98-b0a5-416658f5968b on hv-cinder-85032 Aug 23 16:42:14.529855 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-92f3f56b-3d18-4d7a-ac2e-171d1876c4dc req-04662355-0bbf-44f3-a818-f2f4eeba8bbf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044012 Aug 23 16:42:14.534327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 302/588] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:14.965072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:14.965626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:14.972957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:14.973332 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:14.973954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:14.974834 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:14.975469 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:14.975921 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:15.006093 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:42:15.121566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:15.122391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:15.129006 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:15.130113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:15.133474 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:15.133474 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:15.133474 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:15.133474 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:15.286385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:15.296715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b037c81a-2f81-428e-989c-a617a5058f83 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.177510 Aug 23 16:42:15.296715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 303/589] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:15 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:15.343374 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d24f5ce7-47c0-4f57-bd7a-a7a7f5bd32ac tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 204 len: 0 microversion: 2.1 time: 0.381958 Aug 23 16:42:15.344084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 287/590] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:42:14 2022] DELETE /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:42:15.354991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:15.355860 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:15.361830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:15.362335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:15.362762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:15.363463 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:15.364091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:15.364553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:15.417989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:15.418804 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:15.425702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:15.426182 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:15.426608 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:15.427302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:15.427773 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:15.428459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:15.463072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:15.463590 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:15.464010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:15.464648 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lazy-loading 'fault' on Instance uuid d1ce2e0d-564c-4b98-b0a5-416658f5968b {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:42:15.516259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:15.526683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a7e5f68f-a0e6-4412-ae96-c54dd94026cb tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1309 microversion: 2.1 time: 0.112956 Aug 23 16:42:15.527273 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 288/591] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:15 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:15.539636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:15.548188 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-17427a88-4d6e-4e81-aaf4-b2b89a604153 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1505 microversion: 2.1 time: 0.197259 Aug 23 16:42:15.548774 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 304/592] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:15 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:16.315621 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:16.316261 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:16.323261 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:16.323753 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:16.324216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:16.324947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:16.325384 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:16.325809 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:16.478045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:16.486275 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a3dc4edd-2430-4ad3-86b4-1b299cdb8f06 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.174586 Aug 23 16:42:16.486876 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 289/593] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:16 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:16.548610 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:16.549224 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:16.555805 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:16.556327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:16.556774 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:16.557502 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:16.557958 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:16.558388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:16.569829 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:16.573960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:16.577211 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:16.577691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:16.578343 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:16.579248 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:16.579611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:16.581487 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:16.594525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:16.595126 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:16.595585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:16.597154 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lazy-loading 'fault' on Instance uuid d1ce2e0d-564c-4b98-b0a5-416658f5968b {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:42:16.667042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:16.675098 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7d792788-ac01-48d8-a653-cd4c327068fd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1309 microversion: 2.1 time: 0.130369 Aug 23 16:42:16.675606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 305/594] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:16 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1309 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:16.737907 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:16.746169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-254332fb-f9be-49ce-a7e5-a496917fcfd8 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1505 microversion: 2.1 time: 0.180278 Aug 23 16:42:16.746753 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 290/595] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:16 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:17.507780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:17.508432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:17.514644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:17.515137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:17.515583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:17.516485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:17.516994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:17.517429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:17.656424 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:17.664802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e0d7da22-01dc-4717-ad8a-bad3b51f041b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1371 microversion: 2.1 time: 0.161003 Aug 23 16:42:17.665718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 306/596] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:17 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:17.697432 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:17.698982 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:17.704952 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:17.705441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:17.705877 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:17.706637 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:17.707091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:17.707513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:17.744269 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:17.744747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:17.745185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:17.745669 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lazy-loading 'fault' on Instance uuid d1ce2e0d-564c-4b98-b0a5-416658f5968b {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:42:17.768399 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:17.769024 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:17.775575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:17.776066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:17.776542 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:17.777350 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:17.777817 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:17.778265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:17.789653 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:17.793158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:17.800531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0c7c6d2e-973f-4a14-815e-9ed2e5693e23 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 200 len: 1309 microversion: 2.1 time: 0.104959 Aug 23 16:42:17.800531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 291/597] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:17 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:17.934961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:17.943483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-32fa2f00-4c95-4bfa-97a2-a0d388fd5113 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1505 microversion: 2.1 time: 0.179133 Aug 23 16:42:17.944057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 307/598] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:17 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:18.687158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:18.687482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:18.694727 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:18.695197 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:18.695622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:18.696320 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:18.696768 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:18.697240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:18.823738 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:18.824425 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: d1ce2e0d-564c-4b98-b0a5-416658f5968b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:18.831865 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:18.832382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:18.832933 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:18.833506 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:18.833953 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:18.834571 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:18.853506 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:18.856758 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] HTTP exception thrown: Instance d1ce2e0d-564c-4b98-b0a5-416658f5968b could not be found. Aug 23 16:42:18.861017 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ec2c1308-00c2-4c57-b328-648221867b3d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1565 microversion: 2.1 time: 0.178633 Aug 23 16:42:18.874375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 292/599] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:18 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Request method failure captured: Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b HTTP/1.1 Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQLs648dEM-uOJ7wB6S2_y8NkHjVSM7aEcNJSnSa928onrv51JE-rk0l0pHuyyARKytH6imYO2d5oOBhy14PkniCbBcurroy-zBtoOPnuUrtQXpMW0bIqvUCVGPBu_qrwnBU1xtlch8zPBm7Fh9yodQA5ZfSTwOyKagtbRIqRxEGwFE Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 607930a9b6ea4abaa9783f197824331a Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1888349221 Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:42:18.874520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/607930a9b6ea4abaa9783f197824331a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/607930a9b6ea4abaa9783f197824331a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_607930a9b6ea4abaa9783f197824331a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/607930a9b6ea4abaa9783f197824331a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesSnapshotTestJSON-1888349221 Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 607930a9b6ea4abaa9783f197824331a Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1888349221 Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesSnapshotTestJSON-1888349221-project Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 36f919a0881e47b893bf2cad5367ed58 Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesSnapshotTestJSON-1888349221-project Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance d1ce2e0d-564c-4b98-b0a5-416658f5968b could not be found. Aug 23 16:42:18.876021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'd1ce2e0d-564c-4b98-b0a5-416658f5968b'} Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ce2e0d-564c-4b98-b0a5-416658f5968b could not be found. Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:42:18.876966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ce2e0d-564c-4b98-b0a5-416658f5968b could not be found. Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ce2e0d-564c-4b98-b0a5-416658f5968b could not be found. Aug 23 16:42:18.878926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:18.881032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Returning 404 to user: Instance d1ce2e0d-564c-4b98-b0a5-416658f5968b could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:42:18.881032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a286733f-97cd-4456-9950-5e3eaf10afa7 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b" status: 404 len: 111 microversion: 2.1 time: 0.046961 Aug 23 16:42:18.881032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 308/600] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:18 2022] GET /compute/v2.1/servers/d1ce2e0d-564c-4b98-b0a5-416658f5968b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:42:18.891825 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-922c91a7-6398-4933-9007-f04d60970dd1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:18.892837 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-922c91a7-6398-4933-9007-f04d60970dd1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:18.900747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-922c91a7-6398-4933-9007-f04d60970dd1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:18.902971 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-922c91a7-6398-4933-9007-f04d60970dd1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:18.902971 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-922c91a7-6398-4933-9007-f04d60970dd1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:18.903392 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-922c91a7-6398-4933-9007-f04d60970dd1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:18.903947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-922c91a7-6398-4933-9007-f04d60970dd1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:18.904934 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-922c91a7-6398-4933-9007-f04d60970dd1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:18.969064 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:18.971969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:18.982840 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:18.988744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:18.988744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:18.988744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:18.988744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:18.989121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:19.024769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-922c91a7-6398-4933-9007-f04d60970dd1 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132143 Aug 23 16:42:19.024769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 293/601] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 23 16:42:18 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:19.312856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:19.312856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b853c524-75c1-4a5c-b1c4-45889f979491 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1505 microversion: 2.1 time: 0.349507 Aug 23 16:42:19.312856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 309/602] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:18 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:19.347021 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-999e13f1-0c50-4c9e-b4c6-8d24c169ba14 req-ab3e575a-d5b4-4cf5-91b9-6ca35e9dcbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a509a04-13ef-4eb9-8a65-ae4a3f605742", "name": "network-vif-deleted", "tag": "53cae68c-bdbe-4755-9367-4dbc50a625ea"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:19.359908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-999e13f1-0c50-4c9e-b4c6-8d24c169ba14 req-ab3e575a-d5b4-4cf5-91b9-6ca35e9dcbf2 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:19.360397 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-999e13f1-0c50-4c9e-b4c6-8d24c169ba14 req-ab3e575a-d5b4-4cf5-91b9-6ca35e9dcbf2 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:19.360822 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-999e13f1-0c50-4c9e-b4c6-8d24c169ba14 req-ab3e575a-d5b4-4cf5-91b9-6ca35e9dcbf2 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:19.372224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-999e13f1-0c50-4c9e-b4c6-8d24c169ba14 req-ab3e575a-d5b4-4cf5-91b9-6ca35e9dcbf2 service nova] Creating event network-vif-deleted:53cae68c-bdbe-4755-9367-4dbc50a625ea for instance 1a509a04-13ef-4eb9-8a65-ae4a3f605742 on hv-cinder-85032 Aug 23 16:42:19.377094 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-999e13f1-0c50-4c9e-b4c6-8d24c169ba14 req-ab3e575a-d5b4-4cf5-91b9-6ca35e9dcbf2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034745 Aug 23 16:42:19.378081 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 294/603] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:20.331931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:20.332808 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:20.343264 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:20.345196 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:20.345944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:20.347633 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:20.348512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:20.349345 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:20.390641 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:20.391468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:20.392212 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:20.392908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lazy-loading 'fault' on Instance uuid 1a509a04-13ef-4eb9-8a65-ae4a3f605742 {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:42:20.478456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8a23dda6cf24ee6a6c73cd1d6189dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4b82742e5d94428b3397db5e6b6dfd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:20.487433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4591f566-c7ed-4ff3-bcfc-79060a93f124 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 200 len: 1304 microversion: 2.1 time: 0.158980 Aug 23 16:42:20.488158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 310/604] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:20 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 1304 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:20.491524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-955697d5-5f1f-4823-b764-0671abca589c req-cad5fef5-d23a-461a-a17a-e42642e96176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de441a4-ffc5-43ff-bf83-faec28f6ed1f", "tag": "a6f566e4-5cdd-45cb-b319-5370499e6059"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:20.512052 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-955697d5-5f1f-4823-b764-0671abca589c req-cad5fef5-d23a-461a-a17a-e42642e96176 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:20.512052 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-955697d5-5f1f-4823-b764-0671abca589c req-cad5fef5-d23a-461a-a17a-e42642e96176 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:20.512052 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-955697d5-5f1f-4823-b764-0671abca589c req-cad5fef5-d23a-461a-a17a-e42642e96176 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:20.518866 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-955697d5-5f1f-4823-b764-0671abca589c req-cad5fef5-d23a-461a-a17a-e42642e96176 service nova] Creating event network-changed:a6f566e4-5cdd-45cb-b319-5370499e6059 for instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f on hv-cinder-85032 Aug 23 16:42:20.524002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-955697d5-5f1f-4823-b764-0671abca589c req-cad5fef5-d23a-461a-a17a-e42642e96176 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038824 Aug 23 16:42:20.524659 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 295/605] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:21.520025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:21.520685 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] [instance: 1a509a04-13ef-4eb9-8a65-ae4a3f605742] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:21.527221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:21.527710 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:21.528149 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:21.528871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:21.529332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:21.529757 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:21.544135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] HTTP exception thrown: Instance 1a509a04-13ef-4eb9-8a65-ae4a3f605742 could not be found. Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Request method failure captured: Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 HTTP/1.1 Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQL33BkN9dBY5ueHrDRvU1TZWSl2aW0gE7u0YHhlZsJS5oQ9sKG-IA7QWb6huzXeAiUoebBl7cmiiAFSgSTjsaxWT0Hl68fflS2jJ4D71zTnKZ7frdsSH7Qrg6Ja5LYpgXmGbjis1d4QTxmeoPdQNsDYF_ou5_NKKSVyfqfFoombqrI Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: e4b82742e5d94428b3397db5e6b6dfd3 Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesActionsTest-1550296046 Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:42:21.545701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4b82742e5d94428b3397db5e6b6dfd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4b82742e5d94428b3397db5e6b6dfd3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4b82742e5d94428b3397db5e6b6dfd3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4b82742e5d94428b3397db5e6b6dfd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesActionsTest-1550296046 Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: e4b82742e5d94428b3397db5e6b6dfd3 Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesActionsTest-1550296046 Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesActionsTest-1550296046-project Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: b8a23dda6cf24ee6a6c73cd1d6189dca Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesActionsTest-1550296046-project Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 1a509a04-13ef-4eb9-8a65-ae4a3f605742 could not be found. Aug 23 16:42:21.547156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '1a509a04-13ef-4eb9-8a65-ae4a3f605742'} Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a509a04-13ef-4eb9-8a65-ae4a3f605742 could not be found. Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:42:21.548041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a509a04-13ef-4eb9-8a65-ae4a3f605742 could not be found. Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a509a04-13ef-4eb9-8a65-ae4a3f605742 could not be found. Aug 23 16:42:21.550097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:42:21.551928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] Returning 404 to user: Instance 1a509a04-13ef-4eb9-8a65-ae4a3f605742 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:42:21.551928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1e02767b-820e-47d7-992f-1410765c73d2 tempest-VolumesActionsTest-1550296046 tempest-VolumesActionsTest-1550296046-project] 10.222.0.52 "GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742" status: 404 len: 111 microversion: 2.1 time: 0.031034 Aug 23 16:42:21.551928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 311/606] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:21 2022] GET /compute/v2.1/servers/1a509a04-13ef-4eb9-8a65-ae4a3f605742 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:42:36.726765 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:36.728310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=14 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:36.746696 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a112bb55-dcd3-43f5-ad07-665d088b3042 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:36.746696 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a112bb55-dcd3-43f5-ad07-665d088b3042 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:36.749919 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a112bb55-dcd3-43f5-ad07-665d088b3042 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:36.750884 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a112bb55-dcd3-43f5-ad07-665d088b3042 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:36.751177 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a112bb55-dcd3-43f5-ad07-665d088b3042 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:36.752041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a112bb55-dcd3-43f5-ad07-665d088b3042 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:36.752414 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a112bb55-dcd3-43f5-ad07-665d088b3042 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:36.752863 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a112bb55-dcd3-43f5-ad07-665d088b3042 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:36.787897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a112bb55-dcd3-43f5-ad07-665d088b3042 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/ips" status: 200 len: 149 microversion: 2.1 time: 0.064691 Aug 23 16:42:36.788560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 296/607] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:42:36 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/ips => generated 149 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:37.677341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-20ca9f2f-2846-49c8-ae6d-cc3a052444aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:37.677981 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-20ca9f2f-2846-49c8-ae6d-cc3a052444aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:37.680216 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=57 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:37.682234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=86 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:37.687664 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20ca9f2f-2846-49c8-ae6d-cc3a052444aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:37.688156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20ca9f2f-2846-49c8-ae6d-cc3a052444aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:37.688630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20ca9f2f-2846-49c8-ae6d-cc3a052444aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:37.689379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20ca9f2f-2846-49c8-ae6d-cc3a052444aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:37.689834 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20ca9f2f-2846-49c8-ae6d-cc3a052444aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:37.690332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-20ca9f2f-2846-49c8-ae6d-cc3a052444aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:37.721939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-20ca9f2f-2846-49c8-ae6d-cc3a052444aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/ips" status: 200 len: 146 microversion: 2.1 time: 0.048955 Aug 23 16:42:37.722920 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 312/608] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:42:37 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:37.935734 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1361423442", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "networks": [{"uuid": "2d94ba77-c4a8-4d03-ba1e-b200b082d8f9"}]}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:38.005635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] validate_networks() for [('2d94ba77-c4a8-4d03-ba1e-b200b082d8f9', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:42:38.393689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:42:38.394118 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:42:38.394576 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:42:38.394977 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:42:38.395418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:42:38.404151 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:38.404651 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:38.405074 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:38.405784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:38.406226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:38.406639 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:38.425145 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Getting quotas for project 607930a9b6ea4abaa9783f197824331a. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:42:38.429020 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Getting quotas for user 36f919a0881e47b893bf2cad5367ed58 and project 607930a9b6ea4abaa9783f197824331a. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:42:38.440350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:42:38.442660 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:42:38.570795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ec243930-b492-4588-939c-3d773284ad4e tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639561 Aug 23 16:42:38.571962 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 297/609] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:42:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 16:42:38.584572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-967d69eb-19c8-45ec-b8fe-fa2db6c70bb4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:38.589710 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-967d69eb-19c8-45ec-b8fe-fa2db6c70bb4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:38.707690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-967d69eb-19c8-45ec-b8fe-fa2db6c70bb4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:38.718425 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-967d69eb-19c8-45ec-b8fe-fa2db6c70bb4 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1219 microversion: 2.1 time: 0.138744 Aug 23 16:42:38.719339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 313/610] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:38 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:39.740630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:39.741295 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:39.747372 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:39.747845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:39.753089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:39.753089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:39.753089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:39.753089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:39.810522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:39.819050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bc31b43f-ab2b-48bc-a8c7-b1190390aca0 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1223 microversion: 2.1 time: 0.083324 Aug 23 16:42:39.819614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 298/611] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:39 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:39.941363 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-017e52b6-213b-44de-9f67-69feaaa7ce66 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d8ca808-4015-4b24-828c-0c5a9bc30485"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:39.943972 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-017e52b6-213b-44de-9f67-69feaaa7ce66 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:39.952963 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-017e52b6-213b-44de-9f67-69feaaa7ce66 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:39.953551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-017e52b6-213b-44de-9f67-69feaaa7ce66 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:39.954123 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-017e52b6-213b-44de-9f67-69feaaa7ce66 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:39.955458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-017e52b6-213b-44de-9f67-69feaaa7ce66 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:39.955961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-017e52b6-213b-44de-9f67-69feaaa7ce66 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:39.956511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-017e52b6-213b-44de-9f67-69feaaa7ce66 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:40.840647 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:40.841526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:40.857594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:40.859900 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:40.863126 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:40.863818 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:40.864446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:40.865073 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:40.945888 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:40.957081 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6cd7f6cf-dac9-43cd-b3c7-23edf7418fe8 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1271 microversion: 2.1 time: 0.120146 Aug 23 16:42:40.958874 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 299/612] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:40 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:41.137994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-017e52b6-213b-44de-9f67-69feaaa7ce66 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.200609 Aug 23 16:42:41.139519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 314/613] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:42:39 2022] POST /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments => generated 194 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:41.981646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:41.982268 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:41.989351 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:41.989827 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:41.990252 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:41.990939 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:41.991379 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:41.991795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:42.061294 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:42.084812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9a3be202-e5b0-4711-8d80-8d655975de27 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1289 microversion: 2.1 time: 0.093235 Aug 23 16:42:42.084812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 300/614] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:41 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:43.098474 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:43.099471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:43.108833 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:43.110104 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:43.110676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:43.113213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:43.114202 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:43.119316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:43.384970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:43.391016 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8f90900f-0e6a-4574-86df-249589621ce3 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.300215 Aug 23 16:42:43.394964 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 315/615] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:43 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:43.835188 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-edb08d74-9c21-4057-af27-d37a00ce8a7e req-e5e5653e-d4a5-46b5-8b6f-0a2e990c4032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28c4128-b3e2-4980-a7fc-a7294f866af6", "tag": "fa23a674-da93-417a-b779-46e4de5723ad"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:43.853156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-edb08d74-9c21-4057-af27-d37a00ce8a7e req-e5e5653e-d4a5-46b5-8b6f-0a2e990c4032 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:43.855421 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-edb08d74-9c21-4057-af27-d37a00ce8a7e req-e5e5653e-d4a5-46b5-8b6f-0a2e990c4032 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:43.856103 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-edb08d74-9c21-4057-af27-d37a00ce8a7e req-e5e5653e-d4a5-46b5-8b6f-0a2e990c4032 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:43.870570 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-edb08d74-9c21-4057-af27-d37a00ce8a7e req-e5e5653e-d4a5-46b5-8b6f-0a2e990c4032 service nova] Creating event network-changed:fa23a674-da93-417a-b779-46e4de5723ad for instance b28c4128-b3e2-4980-a7fc-a7294f866af6 on hv-cinder-85032 Aug 23 16:42:43.877572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-edb08d74-9c21-4057-af27-d37a00ce8a7e req-e5e5653e-d4a5-46b5-8b6f-0a2e990c4032 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046358 Aug 23 16:42:43.879177 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 301/616] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:43.949343 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8495dbc8-f402-44e0-afa2-fb99c1e74d7b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27150e18-813c-434c-b8d7-1f7a03ad8391"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:43.953871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8495dbc8-f402-44e0-afa2-fb99c1e74d7b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:43.960138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8495dbc8-f402-44e0-afa2-fb99c1e74d7b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:43.960953 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8495dbc8-f402-44e0-afa2-fb99c1e74d7b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:43.961636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8495dbc8-f402-44e0-afa2-fb99c1e74d7b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:43.962605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8495dbc8-f402-44e0-afa2-fb99c1e74d7b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:43.963255 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8495dbc8-f402-44e0-afa2-fb99c1e74d7b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:43.963774 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8495dbc8-f402-44e0-afa2-fb99c1e74d7b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:44.499926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:44.501080 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:44.508747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:44.509526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:44.510220 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:44.511231 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:44.511843 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:44.512457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:44.861806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:44.892320 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4da515d1-e9e4-4ab6-aefc-14c9bab4b978 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.396044 Aug 23 16:42:44.894341 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 302/617] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:44 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:42:45.175211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8495dbc8-f402-44e0-afa2-fb99c1e74d7b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.222255 Aug 23 16:42:45.179297 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 316/618] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:42:43 2022] POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/os-volume_attachments => generated 194 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:45.915445 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:45.916137 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:45.923124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:45.923863 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:45.924509 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:45.926275 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:45.926933 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:45.927555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:46.109594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:46.119866 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d403a5b4-86d5-4894-a843-e0177eb24951 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.208482 Aug 23 16:42:46.120491 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 303/619] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:45 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:47.147010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:47.147630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:47.154538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:47.155023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:47.155464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:47.156155 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:47.156633 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:47.157065 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:47.304567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:47.310254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ea724422-54f0-43be-b717-9e4f009a4165 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.167723 Aug 23 16:42:47.310977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 317/620] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:47 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:48.331538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:48.332150 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:48.338847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:48.339568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:48.340233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:48.340996 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:48.341663 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:48.342284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:48.413617 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:48.438209 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:48.515591 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:48.524583 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4d2de1ef-16a9-4bdd-9e09-c757dcef3e40 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.197134 Aug 23 16:42:48.526499 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 304/621] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:48 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:49.550003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:49.552368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:49.559240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:42:49.561507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:49.562245 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:49.562917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:49.563803 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:49.564732 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:49.565344 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:49.723223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:49.732605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c6873b04-d52f-400c-b521-f309dd08893f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.187503 Aug 23 16:42:49.749005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 318/622] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:49 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:50.755872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:50.756539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:50.771999 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:50.772429 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:50.773057 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:50.773989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:50.776053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:50.776683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:50.941714 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:50.950367 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-991dc554-bcd4-4888-9577-8f76f9432aef tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.198970 Aug 23 16:42:50.966659 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 305/623] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:50 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:51.975842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:51.976683 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:51.983809 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:51.984440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:51.985057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:51.985787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:51.986252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:51.986780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:52.069688 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4961c226-7dab-400c-86c0-88fa38b41fc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: .version_select at 0x7f67781eda60>, body: {"keypair": {"name": "tempest-keypair-1259670480", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfLB6xabK+8m8kxzqP4D0dFsxBGecpXxGawG53jiF9k8IL3PmP2ftaa4F0aInJUshgJuke78Tlf57CS1WIGJmKaFl0D4i+kN68FrrlE0foAuuw/UDAJN6nJOfKyDsWEfQ=="}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:52.089257 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-4961c226-7dab-400c-86c0-88fa38b41fc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:42:52.094027 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-4961c226-7dab-400c-86c0-88fa38b41fc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for user a642d26e91c8449296a7a6733221824f and project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:42:52.107590 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4961c226-7dab-400c-86c0-88fa38b41fc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [366adc5b-2cdb-494f-90d0-5934236a1f38] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 16:42:52.170820 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:52.180122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7d2fb3fa-c2cc-4d85-a168-f7cc075fb493 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.211179 Aug 23 16:42:52.181107 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 319/624] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:51 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:53.119591 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [None req-4961c226-7dab-400c-86c0-88fa38b41fc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [366adc5b-2cdb-494f-90d0-5934236a1f38] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 49164. Aug 23 16:42:53.199029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4961c226-7dab-400c-86c0-88fa38b41fc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.136099 Aug 23 16:42:53.199958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 306/625] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:42:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:42:53.207484 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:53.208100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:53.217606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:53.217606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:53.217606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:53.218188 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:53.218188 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:53.218188 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:53.379282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:53.387297 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-966532b2-a04d-4c4a-80f9-1b6b4d0e68c2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.184028 Aug 23 16:42:53.388017 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 320/626] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:53 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:54.417732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:54.417732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:54.420854 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:54.421340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:54.421815 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:54.422753 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:54.423205 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:54.423632 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:54.622305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:54.630238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b48cc366-aafa-4ba6-b626-db79914fb15f tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.224620 Aug 23 16:42:54.630742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 307/627] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:54 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:55.345936 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-2ed5fc6a-1d67-4e24-acb7-3379fc0f566b req-f60853ee-5827-41ea-8b3c-a5d472f17e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28c4128-b3e2-4980-a7fc-a7294f866af6", "name": "network-vif-plugged", "status": "completed", "tag": "fa23a674-da93-417a-b779-46e4de5723ad"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:55.356718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-2ed5fc6a-1d67-4e24-acb7-3379fc0f566b req-f60853ee-5827-41ea-8b3c-a5d472f17e5a service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:55.357277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-2ed5fc6a-1d67-4e24-acb7-3379fc0f566b req-f60853ee-5827-41ea-8b3c-a5d472f17e5a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:55.357710 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-2ed5fc6a-1d67-4e24-acb7-3379fc0f566b req-f60853ee-5827-41ea-8b3c-a5d472f17e5a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:55.369404 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-2ed5fc6a-1d67-4e24-acb7-3379fc0f566b req-f60853ee-5827-41ea-8b3c-a5d472f17e5a service nova] Creating event network-vif-plugged:fa23a674-da93-417a-b779-46e4de5723ad for instance b28c4128-b3e2-4980-a7fc-a7294f866af6 on hv-cinder-85032 Aug 23 16:42:55.374413 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-2ed5fc6a-1d67-4e24-acb7-3379fc0f566b req-f60853ee-5827-41ea-8b3c-a5d472f17e5a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032933 Aug 23 16:42:55.375007 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 321/628] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:42:55.650991 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:55.651611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:55.658251 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:55.658732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:55.659170 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:55.660382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:55.660839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:55.661264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:55.801575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-191858939", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8232e7cf-7851-4756-8389-6e87e5a21279"}], "security_groups": [{"name": "tempest-securitygroup--1845917403"}], "key_name": "tempest-keypair-1259670480", "user_data": "}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:42:55.802759 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:55.810508 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bc79a237-043e-419a-a938-54b0c117428b tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.163516 Aug 23 16:42:55.811085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 308/629] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:55 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:55.907501 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] validate_networks() for [('8232e7cf-7851-4756-8389-6e87e5a21279', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:42:56.346814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:42:56.347936 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:42:56.348428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:42:56.348844 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:42:56.349290 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:42:56.358600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:56.359083 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:56.359609 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:56.360381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:56.360844 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:56.361278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:56.378302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:42:56.383280 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for user a642d26e91c8449296a7a6733221824f and project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:42:56.393283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:42:56.396190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:42:56.540429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5416bce1-385a-456d-af03-8a55d4055404 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.743858 Aug 23 16:42:56.541079 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 322/630] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:42:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 16:42:56.552365 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bb19ccbb-30cd-40ef-90f2-9804609dae0d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:56.552984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bb19ccbb-30cd-40ef-90f2-9804609dae0d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:56.615884 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bb19ccbb-30cd-40ef-90f2-9804609dae0d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:56.623423 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bb19ccbb-30cd-40ef-90f2-9804609dae0d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1241 microversion: 2.1 time: 0.075099 Aug 23 16:42:56.624083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 309/631] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:56 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:56.831879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:56.832611 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:56.839490 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:56.840064 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:56.841538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:56.841538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:56.842062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:56.842244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:56.983670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:56.991854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d07daa4a-97e3-41e3-901f-1a3d2e18fc9c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.163963 Aug 23 16:42:56.992462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 323/632] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:56 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:57.645155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:57.646387 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:57.654493 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:57.656061 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:57.656634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:57.657659 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:57.658309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:57.658824 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:57.723125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:57.731948 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e5321391-3104-45e8-ab74-de3d611c45f6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1245 microversion: 2.1 time: 0.091229 Aug 23 16:42:57.732561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 310/633] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:57 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:58.017920 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:58.018802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:58.027397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:58.027896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:58.028393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:58.029112 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:58.029594 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:58.030054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:58.162039 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:58.169808 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-517e593a-dd50-4dd4-9301-e5e97dedfc05 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.158591 Aug 23 16:42:58.170379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 324/634] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:58 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:58.751790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:58.752467 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:58.759026 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:58.759503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:58.759938 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:58.760660 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:58.761115 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:58.761538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:58.822957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:58.830671 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e447f597-7db4-4231-8924-ce573877c108 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1245 microversion: 2.1 time: 0.082737 Aug 23 16:42:58.837686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 311/635] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:58 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:59.189929 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:59.190475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:59.196900 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:59.197382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:59.197820 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:59.198506 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:59.198956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:59.199379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:59.329481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:59.337570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9f4d2766-5f70-4929-91af-d4d6d0c15b3a tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.151517 Aug 23 16:42:59.338124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 325/636] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:59 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:42:59.850848 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:42:59.851503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:42:59.858130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:59.858609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:59.859036 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:59.859719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:42:59.860186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:42:59.860606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:42:59.922264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:42:59.930475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bba3049c-014d-4fe0-8348-63a790922642 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1245 microversion: 2.1 time: 0.083434 Aug 23 16:42:59.931052 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 312/637] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:42:59 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:00.359323 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:00.359937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:00.367204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:00.367742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:00.368200 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:00.368912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:00.369370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:00.369799 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:00.515873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:00.524263 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4f565090-8a4d-4d11-866d-6c7ea8d8fa10 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.168797 Aug 23 16:43:00.524844 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 326/638] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:00 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:00.950931 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:00.951565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:00.959000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:00.959494 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:00.959936 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:00.960684 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:00.961139 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:00.961563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:01.024250 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:01.032153 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-62850bf1-6243-4179-a6f5-0d44b7167fb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1237 microversion: 2.1 time: 0.085136 Aug 23 16:43:01.032740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 313/639] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:00 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:01.547590 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:01.548225 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:01.555181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:01.555871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:01.556342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:01.557043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:01.557501 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:01.557931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:01.687978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:01.695500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-772667fa-5dc6-444a-b866-faf48c663abd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.151944 Aug 23 16:43:01.696060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 327/640] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:01 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:02.052976 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:02.053592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:02.060133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:02.060655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:02.061089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:02.061780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:02.062236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:02.062663 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:02.124329 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:02.132095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7aa1545c-88e8-4638-8deb-11af49d50a42 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1237 microversion: 2.1 time: 0.083021 Aug 23 16:43:02.132693 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 314/641] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:02 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:02.715925 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:02.716565 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:02.722956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:02.723442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:02.723885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:02.724606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:02.725062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:02.725492 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:02.743724 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:02.855387 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:02.862960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-863c15ff-3c8a-402a-b7b4-32990606718c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1319 microversion: 2.1 time: 0.150889 Aug 23 16:43:02.863528 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 328/642] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:02 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:03.153502 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:03.154038 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:03.160687 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:03.161655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:03.162244 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:03.162937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:03.163381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:03.163795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:03.227685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:03.236197 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-eb9ceec4-e579-4998-b760-b61eb2dc880c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1293 microversion: 2.1 time: 0.086660 Aug 23 16:43:03.237098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 315/643] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:03 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:03.885223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:03.886057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:03.896462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:03.897039 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:03.897539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:03.898301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:03.898826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:03.899243 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:04.039082 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:04.047445 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-48e0e962-7b74-4625-a684-9a83ce60c696 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1508 microversion: 2.1 time: 0.167491 Aug 23 16:43:04.048025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 329/644] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:03 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:04.070915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-996a775e-bf1a-45c7-bcbf-7b55bd6b2636 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be06bc17-17fb-4597-980b-e59b4ebad8c6", "device": "/dev/sdb"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:43:04.073770 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-996a775e-bf1a-45c7-bcbf-7b55bd6b2636 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:04.079685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-996a775e-bf1a-45c7-bcbf-7b55bd6b2636 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:04.080119 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-996a775e-bf1a-45c7-bcbf-7b55bd6b2636 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:04.080648 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-996a775e-bf1a-45c7-bcbf-7b55bd6b2636 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:04.081331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-996a775e-bf1a-45c7-bcbf-7b55bd6b2636 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:04.081777 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-996a775e-bf1a-45c7-bcbf-7b55bd6b2636 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:04.082192 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-996a775e-bf1a-45c7-bcbf-7b55bd6b2636 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:04.086404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:04.258030 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:04.258748 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:04.264639 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:04.265128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:04.265570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:04.266264 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:04.266719 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:04.267146 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:04.327662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:04.335658 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ae716f08-d9b0-47f5-aeff-bcbdf7a3f6c4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1293 microversion: 2.1 time: 0.082147 Aug 23 16:43:04.336238 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 330/645] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:04 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:05.356472 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:05.357129 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:05.363755 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:05.365044 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:05.365485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:05.366186 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:05.366642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:05.367069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:05.429110 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:05.436749 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-164d8bf5-97cc-4726-b779-6581739acd72 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1301 microversion: 2.1 time: 0.084365 Aug 23 16:43:05.437313 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 331/646] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:05 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:06.111666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fcfb0804-0395-4c09-9c64-c964cf64aef3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:43:06.117829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcfb0804-0395-4c09-9c64-c964cf64aef3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:06.118316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcfb0804-0395-4c09-9c64-c964cf64aef3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:06.118759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcfb0804-0395-4c09-9c64-c964cf64aef3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:06.178323 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fcfb0804-0395-4c09-9c64-c964cf64aef3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Going to try to stop instance {{(pid=133198) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 16:43:06.322555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-996a775e-bf1a-45c7-bcbf-7b55bd6b2636 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "POST /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.253497 Aug 23 16:43:06.324515 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 316/647] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:43:04 2022] POST /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6/os-volume_attachments => generated 194 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:43:06.368263 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:06.400188 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=6 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:06.434564 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fcfb0804-0395-4c09-9c64-c964cf64aef3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/action" status: 202 len: 0 microversion: 2.1 time: 0.326611 Aug 23 16:43:06.435362 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 332/648] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:43:06 2022] POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 16:43:06.445501 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:06.446289 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:06.455119 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:06.456011 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:06.462070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:06.462191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:06.462284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:06.462374 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:06.462472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:06.462472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:06.469100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:06.469723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:06.470624 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:06.473752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:06.473962 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:06.475330 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:06.600278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:06.610165 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-12fa0bbb-383b-42ee-8c78-d56f172cb0e2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1299 microversion: 2.1 time: 0.155503 Aug 23 16:43:06.611068 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 333/649] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:06 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:06.620678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:06.707788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:06.717490 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-311747a7-a357-45a3-84ce-75d38779ea81 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.277497 Aug 23 16:43:06.718074 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 317/650] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:06 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:07.632730 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:07.633246 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:07.639562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:07.640426 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:07.641178 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:07.643288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:07.643821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:07.644470 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:07.746270 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:07.746270 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:07.747722 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:07.748239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:07.748686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:07.749388 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:07.749846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:07.750273 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:07.879147 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:07.887151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-08de3c5e-487b-411b-aa03-3af6626d89ba tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.258322 Aug 23 16:43:07.887925 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 334/651] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:07 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:07.929066 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:07.937238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-14893e3b-513d-45d8-972d-1b08162561a0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.202292 Aug 23 16:43:07.937806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 318/652] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:07 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:07.996826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-39bcfd46-6cae-4ac1-bb21-b525a3181413 req-21db81de-c153-4919-ab9f-f504cd9c01f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7187ddca-2154-4ba6-be64-927f9e0c486b", "tag": "26e738ac-fe55-4c06-b907-5a97c243bba5"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:43:08.006463 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-39bcfd46-6cae-4ac1-bb21-b525a3181413 req-21db81de-c153-4919-ab9f-f504cd9c01f5 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:08.007023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-39bcfd46-6cae-4ac1-bb21-b525a3181413 req-21db81de-c153-4919-ab9f-f504cd9c01f5 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:08.007532 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-39bcfd46-6cae-4ac1-bb21-b525a3181413 req-21db81de-c153-4919-ab9f-f504cd9c01f5 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:08.023386 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-39bcfd46-6cae-4ac1-bb21-b525a3181413 req-21db81de-c153-4919-ab9f-f504cd9c01f5 service nova] Creating event network-changed:26e738ac-fe55-4c06-b907-5a97c243bba5 for instance 7187ddca-2154-4ba6-be64-927f9e0c486b on hv-cinder-85032 Aug 23 16:43:08.028426 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-39bcfd46-6cae-4ac1-bb21-b525a3181413 req-21db81de-c153-4919-ab9f-f504cd9c01f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035274 Aug 23 16:43:08.029254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 335/653] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:43:08.909262 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:08.909886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:08.912532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:08.917984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:08.918474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:08.918912 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:08.919661 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:08.920113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:08.920596 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:08.958624 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:08.959235 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:08.961829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:08.967094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:08.967580 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:08.968022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:08.968750 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:08.969207 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:08.969636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:09.111510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:09.120092 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3a8f65ed-1825-467c-8392-314d55e2d516 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.216029 Aug 23 16:43:09.120703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 319/654] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:08 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:09.141505 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:09.150092 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3503267e-06c5-4b6b-9446-1be168c94e2f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.195688 Aug 23 16:43:09.150686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 336/655] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:08 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:10.140980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:10.141595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:10.149250 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:10.149733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:10.150363 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:10.151124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:10.151535 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:10.151957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:10.171861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:10.172495 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:10.179596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:10.180089 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:10.180554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:10.181254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:10.181712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:10.184048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:10.344267 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:10.351992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-74dd9412-5c7c-4e6e-ae8a-f0a1b4943db7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.214956 Aug 23 16:43:10.352604 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 320/656] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:10 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:10.366928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:10.374980 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a5f51fa0-b609-4af8-a5df-a79adf8803c1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.207049 Aug 23 16:43:10.375532 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 337/657] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:10 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:11.373459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:11.374067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:11.380543 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:11.381023 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:11.381455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:11.382142 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:11.382593 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:11.383012 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:11.396576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:11.397185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:11.403536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:11.404022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:11.404595 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:11.405339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:11.405796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:11.406233 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:11.589567 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:11.597999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:11.599771 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4cb0d3a8-eefb-47b4-9651-600910da57b8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.230069 Aug 23 16:43:11.600533 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 321/658] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:11 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:11.607929 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d487fe8d-3b88-4a7f-a2c1-26902fa97260 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.215411 Aug 23 16:43:11.608583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 338/659] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:11 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:12.620663 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:12.621551 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:12.629365 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:12.629846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:12.630517 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:12.630770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:12.631126 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:12.633602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:12.634300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:12.634881 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:12.647401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:12.647401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:12.647401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:12.647401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:12.647745 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:12.647745 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:12.837959 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:12.842698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:12.845744 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2733fe45-728e-4e44-896a-6eea06e63d55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.228995 Aug 23 16:43:12.846492 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 322/660] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:12 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:12.851747 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ae197ef2-f5ad-414a-ab95-e22f6a135c49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.226093 Aug 23 16:43:12.852416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 339/661] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:12 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:13.866956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:13.867558 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:13.871964 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:13.872615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:13.874066 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:13.874551 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:13.874980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:13.875665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:13.876115 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:13.876554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:13.879347 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:13.880352 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:13.880831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:13.881499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:13.881955 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:13.882386 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:14.082817 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:14.088022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:14.091696 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1961f59a-5dfe-44df-80da-9c84e259afdf tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.228576 Aug 23 16:43:14.092305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 323/662] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:13 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:14.096542 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8918c301-abd2-4f10-b96f-8f3d84e9e4f3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.228287 Aug 23 16:43:14.097182 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 340/663] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:13 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:15.112758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:15.113552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:15.117811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:15.118428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:15.121376 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:15.121867 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:15.122309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:15.123015 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:15.123464 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:15.123890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:15.124921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:15.125409 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:15.125846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:15.126545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:15.126998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:15.127429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:15.337032 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:15.343762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:15.345248 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4f3fd333-61da-48ff-a001-a12681b8f012 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.236412 Aug 23 16:43:15.345919 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 324/664] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:15 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:15.352883 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e8602ef5-2799-44d1-b092-05a9b550fec7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.239498 Aug 23 16:43:15.353449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 341/665] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:15 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:16.367459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:16.368091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:16.374460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:16.374662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:16.375084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:16.375443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:16.375554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:16.376258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:16.376780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:16.377262 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:16.385470 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:16.385957 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:16.386393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:16.387097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:16.387579 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:16.388050 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:16.576336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:16.584348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-464c42e6-6a96-4598-817e-381b98455ff4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.221396 Aug 23 16:43:16.584935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 325/666] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:16 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:16.588035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:16.596468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7107250e-c26a-410a-bd31-45310fb385dc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.225546 Aug 23 16:43:16.597037 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 342/667] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:16 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:17.605663 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:17.606273 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:17.612732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:17.613207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:17.613631 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:17.614871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:17.615314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:17.615726 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:17.618740 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:17.619352 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:17.625813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:17.626331 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:17.626772 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:17.627470 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:17.627932 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:17.628453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:17.814910 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:17.817909 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:17.822962 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-54c31110-c12b-4c2b-89c0-331f906fd122 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.221355 Aug 23 16:43:17.823545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 326/668] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:17 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:17.825978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7b21fbac-6cc9-479c-8b18-131455080f0d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.211647 Aug 23 16:43:17.826530 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 343/669] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:17 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:18.843423 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:18.844153 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:18.848938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:18.849587 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:18.851252 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:18.851743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:18.852199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:18.852903 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:18.853358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:18.853792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:18.855879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:18.856474 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:18.856920 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:18.857662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:18.858125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:18.858608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:19.052812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:19.062735 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cc93f920-c780-4142-819c-4b378355cc39 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.222809 Aug 23 16:43:19.072540 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 327/670] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:18 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:19.072933 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:19.072933 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:19.075697 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-202acd73-ebe8-477a-b125-f23eb480d948 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.231953 Aug 23 16:43:19.076433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 344/671] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:18 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:20.084698 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:20.085327 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:20.094117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:20.094610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:20.095045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:20.095746 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:20.096216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:20.096856 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:20.097830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:20.098449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:20.105814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:20.106310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:20.106914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:20.107473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:20.108121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:20.108639 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:20.310157 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:20.314219 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:20.318009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a25645ec-e57d-48a3-beae-f2d65c44e65a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.237560 Aug 23 16:43:20.319144 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 328/672] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:20 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:20.323150 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6734bb1f-7cae-4243-82b7-6b7ae6de3c16 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.229323 Aug 23 16:43:20.338234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 345/673] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:20 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:21.340593 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:21.341212 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:21.344063 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:21.345203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:21.347911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:21.352764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:21.352764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:21.352764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:21.352764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:21.353105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:21.353190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:21.353190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:21.353190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:21.353646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:21.354537 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:21.355135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:21.564329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:21.572738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:21.573782 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a3c0d9b7-9373-412d-bc9f-39245f0beb34 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.233482 Aug 23 16:43:21.574382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 346/674] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:21 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:21.580545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a06ba97c-470e-4e52-8d0c-b8fc6c94260f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.244788 Aug 23 16:43:21.581228 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 329/675] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:21 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:22.594895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:22.595506 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:22.601208 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:22.601957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:22.602203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:22.602815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:22.603251 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:22.604007 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:22.604796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:22.605277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:22.609890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:22.610456 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:22.611017 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:22.611792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:22.612354 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:22.612884 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:22.805143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:22.808785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:22.813670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0953384e-afc0-45cf-9da8-e58a9daef98d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.222704 Aug 23 16:43:22.814760 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 347/676] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:22 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:22.816574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-495db000-d196-4d2c-a040-12d4aa237a9b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.219269 Aug 23 16:43:22.817153 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 330/677] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:22 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:23.835970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:23.836523 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:23.838235 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:23.838859 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:23.843169 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:23.849563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:23.849563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:23.849563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:23.849840 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:23.849923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:23.850010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:23.850100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:23.850176 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:23.850176 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:23.850176 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:23.850176 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:23.866382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:24.049599 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:24.058542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:24.059012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-87a404ed-7d91-41aa-9e98-f811ae544e44 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.227860 Aug 23 16:43:24.059670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 348/678] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:23 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:24.064843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-53b65e98-a9f1-47a3-b12e-3f9a6178cff5 req-bde55784-8640-4be8-96c9-194802b935be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7187ddca-2154-4ba6-be64-927f9e0c486b", "name": "network-vif-plugged", "status": "completed", "tag": "26e738ac-fe55-4c06-b907-5a97c243bba5"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:43:24.066495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9570b8b6-6387-4c6b-bf51-34f3e20b9671 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.232669 Aug 23 16:43:24.067459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 331/679] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:23 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:24.074841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-53b65e98-a9f1-47a3-b12e-3f9a6178cff5 req-bde55784-8640-4be8-96c9-194802b935be service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:24.075324 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-53b65e98-a9f1-47a3-b12e-3f9a6178cff5 req-bde55784-8640-4be8-96c9-194802b935be service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:24.075797 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-53b65e98-a9f1-47a3-b12e-3f9a6178cff5 req-bde55784-8640-4be8-96c9-194802b935be service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:24.088726 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-53b65e98-a9f1-47a3-b12e-3f9a6178cff5 req-bde55784-8640-4be8-96c9-194802b935be service nova] Creating event network-vif-plugged:26e738ac-fe55-4c06-b907-5a97c243bba5 for instance 7187ddca-2154-4ba6-be64-927f9e0c486b on hv-cinder-85032 Aug 23 16:43:24.096248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-53b65e98-a9f1-47a3-b12e-3f9a6178cff5 req-bde55784-8640-4be8-96c9-194802b935be service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035079 Aug 23 16:43:24.097068 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 349/680] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:43:25.081684 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:25.082297 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:25.088719 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:25.089215 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:25.089442 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:25.089541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:25.089895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:25.090588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:25.091044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:25.091477 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:25.095653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:25.096270 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:25.096720 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:25.097420 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:25.097880 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:25.098319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:25.286655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:25.291250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:25.295728 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-578176a5-f39a-4c7d-9b6e-26647f076f91 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1725 microversion: 2.1 time: 0.218183 Aug 23 16:43:25.296323 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 332/681] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:25 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:25.298943 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a9d01597-8f5e-4755-9153-426b7c902767 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.214977 Aug 23 16:43:25.299505 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 350/682] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:25 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:26.316846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:26.317460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:26.318630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:26.319239 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:26.323987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:26.324549 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:26.324988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:26.325686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:26.325792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:26.326141 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:26.326253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:26.326563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:26.326675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:26.327269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:26.327717 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:26.328140 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:26.524868 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:26.528335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:26.533749 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-77f3f8ec-7de4-42e2-bb39-591e7e8256b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1702 microversion: 2.1 time: 0.220878 Aug 23 16:43:26.534379 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 333/683] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:26 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1702 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:26.536659 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a42736ff-077b-42d0-9e3b-074ac3f5fe56 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.221668 Aug 23 16:43:26.537305 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 351/684] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:26 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:26.554255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-194815d6-a89c-4571-91a3-f90dc1737b0f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:43:26.560805 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-194815d6-a89c-4571-91a3-f90dc1737b0f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:26.561288 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-194815d6-a89c-4571-91a3-f90dc1737b0f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:26.561717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-194815d6-a89c-4571-91a3-f90dc1737b0f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:26.631797 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-194815d6-a89c-4571-91a3-f90dc1737b0f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Going to try to start instance {{(pid=133199) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 16:43:26.813629 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-194815d6-a89c-4571-91a3-f90dc1737b0f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/action" status: 202 len: 0 microversion: 2.1 time: 0.262850 Aug 23 16:43:26.814081 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 334/685] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:43:26 2022] POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:43:26.822789 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:26.823451 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:26.829453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:26.829932 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:26.830369 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:26.831054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:26.831526 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:26.831944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:26.965549 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:26.973929 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f4b7565d-7c8d-4463-9596-909f0e77ddb4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1711 microversion: 2.1 time: 0.155037 Aug 23 16:43:26.979812 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 352/686] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:26 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1711 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:27.561678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:27.562532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:27.568697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:27.569114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:27.569535 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:27.570226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:27.571331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:27.571735 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:27.710127 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:27.718183 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c9570434-f5fc-4b0b-ba68-cb04150fec1a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1367 microversion: 2.1 time: 0.161059 Aug 23 16:43:27.718822 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 335/687] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:27 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:27.997342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:27.997955 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:28.004667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:28.007690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:28.007690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:28.007690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:28.007690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:28.008049 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:28.162067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:28.171802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-37f9aa9a-5427-49fb-9378-c77a7982b4c3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1711 microversion: 2.1 time: 0.178783 Aug 23 16:43:28.172560 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 353/688] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:27 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1711 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:28.740945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:28.741637 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:28.748265 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:28.748897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:28.749390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:28.750085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:28.750527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:28.750944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:29.193773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:29.194403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:29.201428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:29.201910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:29.202368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:29.203057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:29.203507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:29.203926 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:29.222061 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:29.231082 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6e231313-092d-4dd1-a667-6757e103f211 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1557 microversion: 2.1 time: 0.493984 Aug 23 16:43:29.231903 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 336/689] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:28 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1557 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:29.251920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5546ef7d-5f15-4b17-bf7c-6cf0f6989476 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:29.252641 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5546ef7d-5f15-4b17-bf7c-6cf0f6989476 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:29.259660 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5546ef7d-5f15-4b17-bf7c-6cf0f6989476 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:29.260146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5546ef7d-5f15-4b17-bf7c-6cf0f6989476 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:29.260592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5546ef7d-5f15-4b17-bf7c-6cf0f6989476 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:29.261285 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5546ef7d-5f15-4b17-bf7c-6cf0f6989476 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:29.261729 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5546ef7d-5f15-4b17-bf7c-6cf0f6989476 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:29.262143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5546ef7d-5f15-4b17-bf7c-6cf0f6989476 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:29.382291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5546ef7d-5f15-4b17-bf7c-6cf0f6989476 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134084 Aug 23 16:43:29.382899 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 337/690] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 23 16:43:29 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:43:29.455051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:29.463617 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-16812ebd-9047-4fb6-9014-bfe70cb5a59b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1711 microversion: 2.1 time: 0.273652 Aug 23 16:43:29.464490 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 354/691] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:29 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1711 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:30.487101 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:30.487742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:30.494648 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:30.495129 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:30.495574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:30.496317 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:30.496766 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:30.497187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:30.648545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:30.656908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-86a836a3-6973-4c18-97da-1b65f92a9e28 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1711 microversion: 2.1 time: 0.174120 Aug 23 16:43:30.661102 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 338/692] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:30 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1711 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:30.723398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-fd953607-8edd-46a4-8f38-8dd49afc5948 req-933e42e0-f671-44c9-9840-1bee1e0162b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7187ddca-2154-4ba6-be64-927f9e0c486b", "tag": "26e738ac-fe55-4c06-b907-5a97c243bba5"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:43:30.734647 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-fd953607-8edd-46a4-8f38-8dd49afc5948 req-933e42e0-f671-44c9-9840-1bee1e0162b1 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:30.735121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-fd953607-8edd-46a4-8f38-8dd49afc5948 req-933e42e0-f671-44c9-9840-1bee1e0162b1 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:30.735548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-fd953607-8edd-46a4-8f38-8dd49afc5948 req-933e42e0-f671-44c9-9840-1bee1e0162b1 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:30.747108 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-fd953607-8edd-46a4-8f38-8dd49afc5948 req-933e42e0-f671-44c9-9840-1bee1e0162b1 service nova] Creating event network-changed:26e738ac-fe55-4c06-b907-5a97c243bba5 for instance 7187ddca-2154-4ba6-be64-927f9e0c486b on hv-cinder-85032 Aug 23 16:43:30.751960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-fd953607-8edd-46a4-8f38-8dd49afc5948 req-933e42e0-f671-44c9-9840-1bee1e0162b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032200 Aug 23 16:43:30.753247 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 355/693] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:43:31.678239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:31.678828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:31.685410 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:31.685879 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:31.686305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:31.686982 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:31.687425 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:31.687839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:31.822341 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:31.830596 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ae38c025-6177-4094-8054-e5a13fb6e8d1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1711 microversion: 2.1 time: 0.156273 Aug 23 16:43:31.831347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 339/694] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:31 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1711 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:32.853100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:32.853915 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:32.860483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:32.860907 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:32.861353 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:32.862045 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:32.862507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:32.862941 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:33.157627 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:33.166016 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1e0a9e9b-641a-42ed-96a9-275af3dced7f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1711 microversion: 2.1 time: 0.318326 Aug 23 16:43:33.166595 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 356/695] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:32 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1711 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:43:34.187035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:34.187649 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:34.194103 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:34.194588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:34.195024 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:34.195709 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:34.196194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:34.196615 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:34.381233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:34.389367 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-72b74888-f0fc-46fb-ad83-d8db799c6ca8 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1711 microversion: 2.1 time: 0.206196 Aug 23 16:43:34.389939 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 340/696] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:34 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1711 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:35.410973 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:35.411589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:35.418554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:35.419045 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:35.419605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:35.420333 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:35.420796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:35.421229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:35.552969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:35.561976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a0d9b212-50e4-4734-b7e0-466d804219ca tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1711 microversion: 2.1 time: 0.154946 Aug 23 16:43:35.562542 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 357/697] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:35 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1711 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:36.583254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:36.583790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:36.590218 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:36.590700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:36.591162 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:36.591923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:36.592287 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:36.592701 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:36.729282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:36.738675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1546fe19-beac-4b68-be7b-eb1a0cba0864 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1711 microversion: 2.1 time: 0.159571 Aug 23 16:43:36.739256 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 341/698] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:36 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:37.761264 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:37.761798 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:37.768240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:37.768725 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:37.769162 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:37.769851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:37.770300 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:37.770724 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:37.898628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:37.906918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6fbc3b88-fff5-4a21-b12f-150e463bbecd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1715 microversion: 2.1 time: 0.150047 Aug 23 16:43:37.907485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 358/699] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:37 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:49.468409 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:49.468937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:49.471547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=45 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:49.472253 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:49.477072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:49.477565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:49.478008 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:49.479206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:49.480098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:49.480546 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:49.607340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lazy-loading 'services' on Instance uuid b28c4128-b3e2-4980-a7fc-a7294f866af6 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:43:49.872552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-51663805-99c9-4f8d-bba5-a9aac650840c tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6/os-volume_attachments/be06bc17-17fb-4597-980b-e59b4ebad8c6" status: 202 len: 0 microversion: 2.1 time: 0.407804 Aug 23 16:43:49.873212 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 342/700] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:43:49 2022] DELETE /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6/os-volume_attachments/be06bc17-17fb-4597-980b-e59b4ebad8c6 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:43:58.390972 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:58.391596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:58.393753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=45 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:58.394432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=76 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:43:58.399057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:58.399561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:58.399990 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:58.401807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:58.401807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:58.401807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:58.427507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Going to try to terminate instance {{(pid=133198) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:43:58.676271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d8cab43d-7bed-49cf-9596-dc32da8aefdd tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 204 len: 0 microversion: 2.1 time: 0.288793 Aug 23 16:43:58.676889 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 359/701] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:43:58 2022] DELETE /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:43:58.686377 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:58.687220 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:58.694133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:58.694614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:58.695044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:58.695749 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:58.696220 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:58.696641 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:58.846806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:43:58.855097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-627c50fa-7bee-484a-9803-50f2a694b56d tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1514 microversion: 2.1 time: 0.173386 Aug 23 16:43:58.855683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 343/702] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:58 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:43:59.877452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:43:59.878047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:43:59.884944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:59.885438 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:59.885881 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:43:59.886583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:43:59.887050 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:43:59.887482 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:00.017868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:00.025781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dde9d042-4835-429a-8dfe-6da09216b9d2 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1514 microversion: 2.1 time: 0.152608 Aug 23 16:44:00.026362 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 360/703] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:43:59 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:44:01.048804 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:01.049457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:01.056209 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:01.059350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:01.059350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:01.059350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:01.059350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:01.059722 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:01.198444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:01.206635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c9c3aeea-59ca-4fee-910c-00d22b194975 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1514 microversion: 2.1 time: 0.161777 Aug 23 16:44:01.207230 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 344/704] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:44:01 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:44:01.940635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-59b6bb35-7160-4b60-854b-03a54a6695d7 req-af7b3565-cecf-4c50-9ce0-bf327ec3d8e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28c4128-b3e2-4980-a7fc-a7294f866af6", "name": "network-vif-deleted", "tag": "fa23a674-da93-417a-b779-46e4de5723ad"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:44:01.951210 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-59b6bb35-7160-4b60-854b-03a54a6695d7 req-af7b3565-cecf-4c50-9ce0-bf327ec3d8e6 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:01.953663 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-59b6bb35-7160-4b60-854b-03a54a6695d7 req-af7b3565-cecf-4c50-9ce0-bf327ec3d8e6 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:01.953663 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-59b6bb35-7160-4b60-854b-03a54a6695d7 req-af7b3565-cecf-4c50-9ce0-bf327ec3d8e6 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:01.963244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-59b6bb35-7160-4b60-854b-03a54a6695d7 req-af7b3565-cecf-4c50-9ce0-bf327ec3d8e6 service nova] Creating event network-vif-deleted:fa23a674-da93-417a-b779-46e4de5723ad for instance b28c4128-b3e2-4980-a7fc-a7294f866af6 on hv-cinder-85032 Aug 23 16:44:01.968938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-59b6bb35-7160-4b60-854b-03a54a6695d7 req-af7b3565-cecf-4c50-9ce0-bf327ec3d8e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032048 Aug 23 16:44:01.969552 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 361/705] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:44:02.228842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:02.229464 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:02.236680 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:02.237143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:02.237579 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:02.238821 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:02.239291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:02.239732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:02.274378 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:02.274857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:02.275285 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:02.275734 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lazy-loading 'fault' on Instance uuid b28c4128-b3e2-4980-a7fc-a7294f866af6 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:44:02.318100 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36f919a0881e47b893bf2cad5367ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607930a9b6ea4abaa9783f197824331a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:02.326676 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4078de9d-8c74-407e-8838-18d7f79ea877 tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 200 len: 1309 microversion: 2.1 time: 0.101985 Aug 23 16:44:02.332143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 345/706] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:44:02 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:44:03.347920 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:03.348655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] [instance: b28c4128-b3e2-4980-a7fc-a7294f866af6] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:03.355617 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:03.356133 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:03.356612 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:03.357313 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:03.357771 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:03.358204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:03.372074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] HTTP exception thrown: Instance b28c4128-b3e2-4980-a7fc-a7294f866af6 could not be found. Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Request method failure captured: Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 HTTP/1.1 Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQLs648dEM-uOJ7wB6S2_y8NkHjVSM7aEcNJSnSa928onrv51JE-rk0l0pHuyyARKytH6imYO2d5oOBhy14PkniCbBcurroy-zBtoOPnuUrtQXpMW0bIqvUCVGPBu_qrwnBU1xtlch8zPBm7Fh9yodQA5ZfSTwOyKagtbRIqRxEGwFE Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 607930a9b6ea4abaa9783f197824331a Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1888349221 Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:44:03.373835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/607930a9b6ea4abaa9783f197824331a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/607930a9b6ea4abaa9783f197824331a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_607930a9b6ea4abaa9783f197824331a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/607930a9b6ea4abaa9783f197824331a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-VolumesSnapshotTestJSON-1888349221 Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 607930a9b6ea4abaa9783f197824331a Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1888349221 Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-VolumesSnapshotTestJSON-1888349221-project Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 36f919a0881e47b893bf2cad5367ed58 Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-VolumesSnapshotTestJSON-1888349221-project Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance b28c4128-b3e2-4980-a7fc-a7294f866af6 could not be found. Aug 23 16:44:03.375401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'b28c4128-b3e2-4980-a7fc-a7294f866af6'} Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b28c4128-b3e2-4980-a7fc-a7294f866af6 could not be found. Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:44:03.376320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b28c4128-b3e2-4980-a7fc-a7294f866af6 could not be found. Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b28c4128-b3e2-4980-a7fc-a7294f866af6 could not be found. Aug 23 16:44:03.377769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:44:03.378991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] Returning 404 to user: Instance b28c4128-b3e2-4980-a7fc-a7294f866af6 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:44:03.378991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-55c5a069-096d-462e-a893-f3e0b7920dee tempest-VolumesSnapshotTestJSON-1888349221 tempest-VolumesSnapshotTestJSON-1888349221-project] 10.222.0.52 "GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6" status: 404 len: 111 microversion: 2.1 time: 0.031575 Aug 23 16:44:03.378991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 362/707] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:44:03 2022] GET /compute/v2.1/servers/b28c4128-b3e2-4980-a7fc-a7294f866af6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:44:46.714467 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d21bbde2-12e3-4308-819c-ed59d9d4489d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:46.726316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d21bbde2-12e3-4308-819c-ed59d9d4489d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:46.726316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=10 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:44:46.726316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:44:46.726316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d21bbde2-12e3-4308-819c-ed59d9d4489d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:46.726316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d21bbde2-12e3-4308-819c-ed59d9d4489d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:46.727369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d21bbde2-12e3-4308-819c-ed59d9d4489d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:46.727369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d21bbde2-12e3-4308-819c-ed59d9d4489d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:46.727369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d21bbde2-12e3-4308-819c-ed59d9d4489d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:46.727369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d21bbde2-12e3-4308-819c-ed59d9d4489d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:46.749888 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d21bbde2-12e3-4308-819c-ed59d9d4489d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/ips" status: 200 len: 151 microversion: 2.20 time: 0.039993 Aug 23 16:44:46.750598 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 346/708] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Aug 23 16:44:46 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:44:52.238328 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:44:52.239516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:52.241638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:44:52.242309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:44:52.247016 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:52.247783 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:52.248254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:52.248958 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:52.249452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:52.249883 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:52.274649 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lazy-loading 'flavor' on Instance uuid 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:44:52.798166 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-99e2fef3-7a1b-4c47-8fd4-8d95a2193bfe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/action" status: 202 len: 0 microversion: 2.20 time: 0.563846 Aug 23 16:44:52.800651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 363/709] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 23 16:44:52 2022] POST /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:44:52.807332 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:52.807951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:52.815398 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:52.815885 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:52.816354 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:52.817050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:52.817504 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:52.817932 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:52.954714 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:52.963690 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:52.966423 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:52.966423 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-597d9328-5ddd-49dd-be5c-45bf74fd586d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.163351 Aug 23 16:44:52.966941 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 347/710] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:44:52 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:44:53.991170 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:53.991856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:53.998157 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:53.998635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:53.999092 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:53.999773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:54.000262 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:54.000671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:54.136865 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:54.145254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:54.146841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:54.148019 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d7d056de-ef79-4670-8518-e56b2efcd938 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.161867 Aug 23 16:44:54.148613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 364/711] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:44:53 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:44:55.170956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:55.171604 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:55.177920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:55.178405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:55.178876 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:55.179616 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:55.180068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:55.180522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:55.312521 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:55.321362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:55.322923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:55.324096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-aac8e950-e1d5-40f7-86a5-5799e7b4361b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.157321 Aug 23 16:44:55.324684 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 348/712] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:44:55 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:44:56.347226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:56.347823 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:56.354546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:56.355028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:56.355776 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:56.356507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:56.356967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:56.357392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:56.498001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:56.506545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:56.508047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:56.509251 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-35b17a6f-1ce3-4c17-8e19-06733bd219a6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.166239 Aug 23 16:44:56.509815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 365/713] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:44:56 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:44:57.543212 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:57.543863 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:57.550369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:57.550852 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:57.551860 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:57.552573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:57.553069 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:57.553494 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:57.684500 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:57.692845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:57.694393 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:57.695569 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-29976766-8502-4832-9830-60195f31d5db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.156326 Aug 23 16:44:57.696134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 349/714] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:44:57 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:44:58.717735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:58.718266 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:58.724779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:58.725270 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:58.725712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:58.726418 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:58.726941 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:58.727312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:58.857553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:58.866294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:58.867913 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:44:58.869146 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-711a0a56-4433-4362-bad0-2abf06dbfd29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.155515 Aug 23 16:44:58.869709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 366/715] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:44:58 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:44:59.891640 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:44:59.892229 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:44:59.899290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:59.899774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:59.900229 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:44:59.900925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:44:59.901427 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:44:59.901855 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:00.037352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:00.045703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:00.047223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:00.048396 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c8c58f4f-3aa1-459d-8c01-7a380e145f69 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.160780 Aug 23 16:45:00.048955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 350/716] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:44:59 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:01.072341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:01.072973 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:01.079332 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:01.079846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:01.080307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:01.081008 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:01.081467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:01.081896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:01.251891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:01.260841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:01.262349 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:01.263597 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fcf04b48-331d-423a-9443-c1c537f5ee1d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.195176 Aug 23 16:45:01.264191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 367/717] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:01 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:02.286196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:02.286803 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:02.293338 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:02.293821 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:02.294254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:02.294948 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:02.295401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:02.295839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:02.432580 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:02.440797 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:02.442929 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:02.444099 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1e149cd7-ec49-4f90-93e9-63d03e7e75f4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.161999 Aug 23 16:45:02.444689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 351/718] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:02 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:45:03.466690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:03.467282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:03.473875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:03.474354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:03.474788 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:03.475476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:03.475928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:03.476387 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:03.604908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:03.613484 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:03.615043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:03.616298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2edcb5e2-0e56-424f-86ed-bb07317f6079 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.153392 Aug 23 16:45:03.616801 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 368/719] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:03 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:04.639499 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:04.640147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:04.647201 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:04.647678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:04.648106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:04.648830 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:04.649278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:04.649716 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:04.781599 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:04.790454 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:04.791975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:04.793180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7330b0f8-7f83-435e-9a9f-3e1a40936708 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.157717 Aug 23 16:45:04.793762 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 352/720] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:04 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:05.816628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:05.817325 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:05.824306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:05.824807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:05.825251 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:05.827735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:05.827735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:05.827735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:05.973100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:05.982984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:05.986529 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:05.986529 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-512d9ea0-c7fd-4379-9c46-2f700bd06d8b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.173426 Aug 23 16:45:05.986529 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 369/721] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:05 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:45:07.010172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:07.010802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:07.017366 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:07.017896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:07.018361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:07.019065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:07.019520 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:07.019935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:07.157533 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:07.166508 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:07.168001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:07.169282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2991f1a7-56c5-4d2f-86da-ea795784fba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.163634 Aug 23 16:45:07.169945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 353/722] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:07 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:08.192134 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:08.192796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:08.199701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:08.200222 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:08.200666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:08.201380 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:08.201848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:08.202274 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:08.340306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:08.348394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:08.349889 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:08.351681 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-86b38ef7-a508-44ef-846b-b5fe2081e103 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.162945 Aug 23 16:45:08.352257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 370/723] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:08 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:09.374587 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:09.375156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:09.381816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:09.382929 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:09.383362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:09.384046 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:09.384528 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:09.384946 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:09.515183 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:09.523758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:09.525528 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:09.526683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-45de3d4b-b8d1-4e46-aabb-c00256ccc92c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.156145 Aug 23 16:45:09.527236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 354/724] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:09 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:10.550192 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:10.550819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:10.558651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:10.559149 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:10.559588 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:10.560344 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:10.560890 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:10.561326 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:10.707205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:10.715642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:10.717182 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:10.718344 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-88c8af37-c3e4-4769-8719-7149a772de79 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.172290 Aug 23 16:45:10.718906 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 371/725] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:10 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:11.742382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:11.743006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:11.749583 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:11.750067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:11.750530 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:11.751298 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:11.751755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:11.752194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:11.882996 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:11.891079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:11.892538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:11.893692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e6ca1ca0-0494-462f-afe1-b880dd985b43 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.155941 Aug 23 16:45:11.894254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 355/726] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:11 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:12.917007 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:12.917645 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:12.924711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:12.925195 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:12.925633 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:12.926324 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:12.926778 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:12.927199 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:13.064469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:13.072509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:13.073988 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:13.075130 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-53df6db7-3a2b-46ca-9f43-2420d3a5d620 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.162924 Aug 23 16:45:13.075676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 372/727] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:12 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:14.098527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:14.099113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:14.105849 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:14.106328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:14.106758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:14.107455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:14.107908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:14.108356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:14.245029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:14.253521 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:14.255025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:14.256262 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-04ff6da8-c221-4371-aafa-ae6319de1502 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1744 microversion: 2.20 time: 0.161786 Aug 23 16:45:14.257313 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 356/728] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:14 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:15.283041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:15.283652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:15.291236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:15.291394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:15.291748 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:15.292580 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:15.292941 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:15.293373 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:15.428065 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:15.436173 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:15.437682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:15.438897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-661c31b4-af45-4ecc-b97c-baf9c75ca45e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1744 microversion: 2.20 time: 0.159881 Aug 23 16:45:15.439465 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 373/729] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:15 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:16.462531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:16.463342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:16.470002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:16.470489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:16.470923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:16.471640 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:16.472095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:16.472581 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:16.611394 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:16.622420 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:16.624225 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:16.626223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c77bee7f-ca93-4cc2-8d9d-5ee60e905cbd tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1744 microversion: 2.20 time: 0.167210 Aug 23 16:45:16.627236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 357/730] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:16 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:16.796538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-559348d8-ea4e-49cd-9592-f5f591fc1233 req-b9b838ec-5955-4a76-98b7-e7cdbebbd6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8", "name": "network-vif-plugged", "status": "completed", "tag": "e24378e6-7626-4b59-81eb-752fbcca503a"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:45:16.806714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-559348d8-ea4e-49cd-9592-f5f591fc1233 req-b9b838ec-5955-4a76-98b7-e7cdbebbd6d3 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:16.807193 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-559348d8-ea4e-49cd-9592-f5f591fc1233 req-b9b838ec-5955-4a76-98b7-e7cdbebbd6d3 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:16.807628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-559348d8-ea4e-49cd-9592-f5f591fc1233 req-b9b838ec-5955-4a76-98b7-e7cdbebbd6d3 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:16.818762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-559348d8-ea4e-49cd-9592-f5f591fc1233 req-b9b838ec-5955-4a76-98b7-e7cdbebbd6d3 service nova] Creating event network-vif-plugged:e24378e6-7626-4b59-81eb-752fbcca503a for instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 on hv-cinder-85032 Aug 23 16:45:16.823995 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-559348d8-ea4e-49cd-9592-f5f591fc1233 req-b9b838ec-5955-4a76-98b7-e7cdbebbd6d3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241800 Aug 23 16:45:16.824638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 374/731] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:45:17.649278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:17.650059 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:17.656777 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:17.657264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:17.657687 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:17.658378 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:17.658817 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:17.659234 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:17.803024 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:17.812023 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:17.813609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:17.814783 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-21ebfb08-9b17-42fd-838f-07ecfa82928d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1744 microversion: 2.20 time: 0.169674 Aug 23 16:45:17.815348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 358/732] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:17 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:18.839713 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:18.840428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:18.846734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:18.857770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:18.857770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:18.857770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:18.857770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:18.858162 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:18.982848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:18.991233 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:18.992810 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:18.994001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f35c13fb-876a-4096-994c-1afde2333762 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1744 microversion: 2.20 time: 0.159610 Aug 23 16:45:18.994573 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 375/733] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:18 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:20.019085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:20.019774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:20.026934 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:20.032117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:20.032117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:20.032117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:20.032117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:20.032737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:20.165133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:20.173885 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:20.175461 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:20.176675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-58f0c193-3077-4f67-98b7-93de7a6b5ef4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1744 microversion: 2.20 time: 0.161638 Aug 23 16:45:20.177236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 359/734] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:20 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:21.200357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:21.201577 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:21.208117 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:21.208631 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:21.209066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:21.209764 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:21.210220 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:21.210639 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:21.408506 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:21.418197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:21.419704 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:21.421026 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-41eaec85-72bc-4694-8724-aa0dff394ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.225003 Aug 23 16:45:21.427304 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 376/735] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:21 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:22.449895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:22.450489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:22.457668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:22.458146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:22.458575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:22.459260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:22.459703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:22.460118 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:22.658561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:22.677545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:22.680922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:22.683497 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4f5cb107-0448-4806-844d-5452cc7f548e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.242034 Aug 23 16:45:22.685242 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 360/736] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:22 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:22.819873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:22.821170 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:22.823180 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=29 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:22.828029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:22.828765 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:22.829387 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:22.830281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:22.830950 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:22.831390 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:22.936670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lazy-loading 'services' on Instance uuid abfc7760-8432-47e6-b2a3-b4052a52201f {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:45:22.940393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:23.181539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-671463e3-d394-49ea-bf2e-8402e52ea626 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "DELETE /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/os-volume_attachments/27150e18-813c-434c-b8d7-1f7a03ad8391" status: 202 len: 0 microversion: 2.1 time: 0.525346 Aug 23 16:45:23.182801 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 377/737] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:45:22 2022] DELETE /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/os-volume_attachments/27150e18-813c-434c-b8d7-1f7a03ad8391 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 16:45:23.726369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:23.727561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:23.734988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=31 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:23.750955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:23.751309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:23.757453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:23.757453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:23.757453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:23.757453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:23.765978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=89 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:23.944706 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:23.954532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:23.956190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:23.957556 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bc5f40c4-9b40-45c1-aadb-47614d61b08b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.248213 Aug 23 16:45:23.958417 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 361/738] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:23 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:24.984412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:24.985030 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:24.992095 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:24.997320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:24.997320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:24.997320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:24.997320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:24.997816 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:25.148329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:25.157095 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:25.158615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:25.159813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-42e2eac3-0714-4333-918b-0c0a5b078967 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.180927 Aug 23 16:45:25.160444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 378/739] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:24 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:25.394620 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-07ee2a9b-d286-4458-8e00-4124bb29bfaa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:45:25.401534 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-07ee2a9b-d286-4458-8e00-4124bb29bfaa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:25.402371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-07ee2a9b-d286-4458-8e00-4124bb29bfaa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:25.403010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-07ee2a9b-d286-4458-8e00-4124bb29bfaa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:25.426933 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-07ee2a9b-d286-4458-8e00-4124bb29bfaa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Going to try to stop instance {{(pid=133199) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 16:45:25.657548 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-07ee2a9b-d286-4458-8e00-4124bb29bfaa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/action" status: 202 len: 0 microversion: 2.1 time: 0.266395 Aug 23 16:45:25.662605 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 362/740] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:45:25 2022] POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:45:25.670983 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:25.671623 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:25.689707 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:25.690456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:25.690898 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:25.691626 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:25.692079 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:25.692538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:25.849588 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:25.859360 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d5755f3a-a362-4ba2-85b6-d9346b03d51a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.195311 Aug 23 16:45:25.860123 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 379/741] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:25 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:26.183486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:26.184213 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:26.190410 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:26.190894 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:26.191368 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:26.192038 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:26.192543 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:26.193018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:26.344738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:26.353769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:26.356140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:26.357387 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0cab7cc1-9551-4af9-b969-0a1928b867d2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.178200 Aug 23 16:45:26.357953 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 363/742] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:26 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:26.883974 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:26.884781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:26.892424 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:26.893041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:26.893298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:26.894370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:26.895306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:26.895306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:27.048555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:27.058051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0c43ea7d-ec11-49e2-8492-30aeecdcc360 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.178618 Aug 23 16:45:27.058675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 380/743] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:26 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:27.385822 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:27.386435 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:27.406199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:27.406715 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:27.407154 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:27.407886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:27.408443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:27.413539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:27.593514 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:27.603589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:27.605427 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:27.606960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-67b3d5fd-e87b-4c76-b3d9-22ff67bf1f45 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.225853 Aug 23 16:45:27.607552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 364/744] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:27 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:28.081356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:28.081976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:28.089095 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:28.089612 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:28.090055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:28.090756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:28.091214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:28.091647 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:28.225283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:28.233266 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-afee44f5-2300-4e77-9d44-7e8862a5241c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.155775 Aug 23 16:45:28.233846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 381/745] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:28 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:28.630313 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:28.631173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:28.638143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:28.638720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:28.639226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:28.640031 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:28.640589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:28.641215 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:28.790216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:28.798552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:28.800227 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:28.801255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-93010fba-0b53-4d73-b44f-182acc2e6a58 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.174895 Aug 23 16:45:28.802132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 365/746] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:28 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:29.257516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:29.259356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:29.266161 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:29.266884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:29.267322 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:29.268186 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:29.268651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:29.269082 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:29.417536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:29.430066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ed4397c3-27e3-491b-a09a-fee18baafffa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.176518 Aug 23 16:45:29.430677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 382/747] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:29 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:29.825613 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:29.826925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:29.833823 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:29.834400 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:29.834897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:29.835664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:29.836202 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:29.836733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:29.846758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 16:45:29.846979 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 16:45:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 (ip 10.222.0.52) !!! Aug 23 16:45:29.985693 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:29.996399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:29.998793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:30.000088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-31ab4b3d-f4ec-4fe2-ae77-f95dd2e033f5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.178364 Aug 23 16:45:30.001106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 366/748] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:29 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:30.453494 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:30.454099 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:30.460580 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:30.461581 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:30.462028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:30.462722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:30.463358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:30.463816 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:30.609514 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:30.617829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1f66f34e-d5ad-45b7-966f-792b9cb84147 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.168135 Aug 23 16:45:30.618416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 383/749] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:30 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:31.023062 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:31.024364 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:31.031998 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:31.032509 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:31.033002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:31.034168 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:31.034591 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:31.035022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:31.187214 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:31.197020 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:31.198650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:31.200089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-fefa36f4-b0ac-4bec-810e-8fc03a2d4916 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.180954 Aug 23 16:45:31.200955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 367/750] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:31 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:31.638202 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:31.638817 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:31.645102 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:31.645582 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:31.646020 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:31.646704 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:31.647155 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:31.647596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:31.784020 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:31.792473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8759fcec-7675-483b-9a40-2ebb1dfad29d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.158227 Aug 23 16:45:31.793067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 384/751] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:31 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:32.222817 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:32.223489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:32.231885 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:32.232971 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:32.233130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:32.233800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:32.234665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:32.235216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:32.389660 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:32.404732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:32.406350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:32.407530 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-353bcee5-df88-497e-aebf-2a30e0282626 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.188636 Aug 23 16:45:32.408139 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 368/752] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:32 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:32.814856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:32.815494 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:32.822503 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:32.829401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:32.829401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:32.829401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:32.829401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:32.829767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:32.957754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:32.966206 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cc5a9cbc-9600-476b-9b6f-6582380c235d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.155313 Aug 23 16:45:32.966779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 385/753] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:32 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:45:33.170459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a787c093-3899-467d-963a-18d815bc6597 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b9a386a-077b-4100-90f3-4fd03534ad7b"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:45:33.172990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a787c093-3899-467d-963a-18d815bc6597 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:33.179222 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a787c093-3899-467d-963a-18d815bc6597 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:33.179705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a787c093-3899-467d-963a-18d815bc6597 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:33.180208 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a787c093-3899-467d-963a-18d815bc6597 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:33.180854 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a787c093-3899-467d-963a-18d815bc6597 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:33.181308 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a787c093-3899-467d-963a-18d815bc6597 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:33.181722 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a787c093-3899-467d-963a-18d815bc6597 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:33.431417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:33.431959 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:33.438049 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:33.438566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:33.439017 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:33.439718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:33.440204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:33.440692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:33.579029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:33.587266 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:33.588811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:33.589975 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5b2242fa-197d-41ef-93e0-11cf8326ea56 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1739 microversion: 2.20 time: 0.163219 Aug 23 16:45:33.590543 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 386/754] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:33 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:45:33.964514 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a787c093-3899-467d-963a-18d815bc6597 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901935 Aug 23 16:45:33.965292 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 369/755] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:45:33 2022] POST /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:45:33.990180 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:33.997583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:33.998044 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:33.998665 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:33.999211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:33.999836 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:34.000330 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:34.000763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:34.130845 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:34.138548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0aaabb71-b8fa-496b-8238-ac759850e99d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.152395 Aug 23 16:45:34.139121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 387/756] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:33 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:34.616328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:34.617062 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:34.624987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:34.625460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:34.625896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:34.626594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:34.627044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:34.627523 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:34.856804 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:34.864873 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:34.866307 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:34.867970 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-33114166-647f-4834-8187-8c507a933b8f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1721 microversion: 2.20 time: 0.256730 Aug 23 16:45:34.868567 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 370/757] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:34 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:35.160802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:35.161595 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:35.168097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:35.168695 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:35.169735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:35.170405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:35.170861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:35.171287 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:35.571134 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:35.578990 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fa7b9a27-78b8-45cf-9f68-5ef130ae58b6 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.422164 Aug 23 16:45:35.579562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 388/758] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:35 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:35.891563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:35.892188 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:35.898698 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:35.899180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:35.900132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:35.900835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:35.901287 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:35.901709 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:36.031958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:36.039976 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:36.041512 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:36.042666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f4a4ada7-eecf-4bcd-93ea-6da38912763a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1721 microversion: 2.20 time: 0.155087 Aug 23 16:45:36.043229 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 371/759] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:35 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:36.600782 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:36.601394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:36.608128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:36.608657 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:36.609100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:36.609795 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:36.610260 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:36.610694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:36.738104 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:36.746576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f98b96ee-7bc1-40ec-9969-80b184cc271c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.149597 Aug 23 16:45:36.747151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 389/760] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:36 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:37.065031 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:37.065655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:37.072733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:37.073207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:37.073653 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:37.074335 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:37.074783 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:37.075204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:37.212450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:37.220815 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:37.222323 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:37.223493 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c6b5087e-0fb4-450c-ba9c-c773ae9366c3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1721 microversion: 2.20 time: 0.162469 Aug 23 16:45:37.224056 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 372/761] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:37 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:37.767001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:37.767607 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:37.774198 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:37.774686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:37.775124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:37.775854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:37.776333 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:37.776757 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:37.905950 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:37.913479 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f9cdb9fb-a117-41fe-a639-8d60353c6e24 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.150410 Aug 23 16:45:37.914036 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 390/762] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:37 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:38.247258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:38.247978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:38.254378 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:38.254868 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:38.255304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:38.256226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:38.256685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:38.257137 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:38.388515 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:38.396812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:38.398319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:38.399511 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7de38d36-1946-4484-ad17-0923121b5817 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1724 microversion: 2.20 time: 0.156696 Aug 23 16:45:38.400195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 373/763] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:38 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:38.422463 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9b0c3eb1-3967-4e56-9a01-ca237ce3cfbe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d663b0f-f2dc-4784-981c-0eb16d2067e5"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:45:38.426644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9b0c3eb1-3967-4e56-9a01-ca237ce3cfbe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:38.431703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b0c3eb1-3967-4e56-9a01-ca237ce3cfbe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:38.432210 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b0c3eb1-3967-4e56-9a01-ca237ce3cfbe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:38.432654 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b0c3eb1-3967-4e56-9a01-ca237ce3cfbe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:38.433346 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b0c3eb1-3967-4e56-9a01-ca237ce3cfbe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:38.433798 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b0c3eb1-3967-4e56-9a01-ca237ce3cfbe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:38.434301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9b0c3eb1-3967-4e56-9a01-ca237ce3cfbe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:38.600281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-713e23d3-3bf9-4385-a17d-2b1e5b8c7212 req-879fa953-a125-444f-8bfc-b0c3feb2126f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8", "name": "network-vif-unplugged", "status": "completed", "tag": "e24378e6-7626-4b59-81eb-752fbcca503a"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:45:38.610598 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-713e23d3-3bf9-4385-a17d-2b1e5b8c7212 req-879fa953-a125-444f-8bfc-b0c3feb2126f service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:38.611185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-713e23d3-3bf9-4385-a17d-2b1e5b8c7212 req-879fa953-a125-444f-8bfc-b0c3feb2126f service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:38.611574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-713e23d3-3bf9-4385-a17d-2b1e5b8c7212 req-879fa953-a125-444f-8bfc-b0c3feb2126f service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:38.622850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.compute.server_external_events [req-713e23d3-3bf9-4385-a17d-2b1e5b8c7212 req-879fa953-a125-444f-8bfc-b0c3feb2126f service nova] Unable to find a host for instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8. Dropping event network-vif-unplugged {{(pid=133199) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 16:45:38.623720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-713e23d3-3bf9-4385-a17d-2b1e5b8c7212 req-879fa953-a125-444f-8bfc-b0c3feb2126f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027633 Aug 23 16:45:38.624993 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 374/764] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 16:45:38.934945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:38.935555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:38.941588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:38.942117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:38.942546 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:38.943234 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:38.943688 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:38.944109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:39.077905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:39.085761 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-84b638ed-d012-4dda-acc5-4db6e2de7ebc tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.154718 Aug 23 16:45:39.086500 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 375/765] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:38 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:45:39.240128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:39.302910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9b0c3eb1-3967-4e56-9a01-ca237ce3cfbe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.884345 Aug 23 16:45:39.303810 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 391/766] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Aug 23 16:45:38 2022] POST /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments => generated 188 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:45:39.426828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:45:39.427423 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:39.434444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:39.434926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:39.435359 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:39.436047 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:39.436535 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:39.436958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:39.439422 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:39.526839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133199) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 16:45:39.848737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2a490a7c-bb95-4e47-89f2-7064c64261d4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/action" status: 202 len: 0 microversion: 2.20 time: 0.425820 Aug 23 16:45:39.849345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 376/767] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 23 16:45:39 2022] POST /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:45:39.858480 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:39.861614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:39.866422 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:39.866913 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:39.867361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:39.868878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:39.869162 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:39.869599 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:40.001830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:40.011016 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:40.012569 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:40.013741 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-392b731c-ecd1-4bf0-90f3-369e4644d1cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1750 microversion: 2.20 time: 0.159538 Aug 23 16:45:40.014299 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 392/768] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:39 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:40.108589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:40.109389 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:40.115503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:40.116371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:40.116464 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:40.117114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:40.117563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:40.118529 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:40.252681 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:40.261161 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-509decca-db47-409d-914b-9b02111491c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.156891 Aug 23 16:45:40.261737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 377/769] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:40 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:41.036303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:41.036994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:41.043366 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:41.043850 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:41.044325 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:41.045031 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:41.045489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:41.045919 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:41.179255 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:41.189197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:41.190716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:41.192197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-75e3db59-dfdd-4c33-811d-68a8d487ac22 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1750 microversion: 2.20 time: 0.159584 Aug 23 16:45:41.197747 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 393/770] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:41 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:41.282329 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:41.283019 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:41.290866 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:41.291405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:41.291976 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:41.292790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:41.293323 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:41.293813 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:41.433065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:41.437693 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6e4c4c57-0125-49fd-b2cf-404e161b51e2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.159464 Aug 23 16:45:41.438267 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 378/771] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:41 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:42.216185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:42.216739 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:42.223856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:42.224403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:42.224846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:42.225611 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:42.226075 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:42.229308 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:42.366812 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:42.376217 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:42.377703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:42.378856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-88bf7cc4-dcf9-4193-890a-72b43237f452 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1752 microversion: 2.20 time: 0.167973 Aug 23 16:45:42.379452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 394/772] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:42 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:42.458147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:42.459326 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:42.467013 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:42.467431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:42.467854 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:42.468568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:42.469082 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:42.469503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:42.590187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:45:42.592813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:42.599160 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:42.599650 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:42.600083 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:42.600812 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:42.601262 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:42.601690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:42.618769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:42.625451 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lazy-loading 'flavor' on Instance uuid 0de441a4-ffc5-43ff-bf83-faec28f6ed1f {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:45:42.627148 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cb296fd0-c066-49bc-a167-7dd164c56a38 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1679 microversion: 2.1 time: 0.172781 Aug 23 16:45:42.627787 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 379/773] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:42 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:42.932706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d3c04595-eba1-4563-b9f6-7af22b081d47 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/action" status: 200 len: 32 microversion: 2.1 time: 0.347428 Aug 23 16:45:42.933568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 395/774] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:45:42 2022] POST /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/action => generated 32 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 16:45:42.946511 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:42.947068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:42.953106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:42.953589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:42.954025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:42.954726 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:42.955202 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:42.955699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:43.108707 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:43.121805 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5d0c0bf0-9d41-48ce-b20c-6071365e6bd5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.182587 Aug 23 16:45:43.122552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 380/775] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:42 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:43.409992 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:43.410776 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:43.416971 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:43.417464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:43.417905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:43.418611 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:43.419055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:43.419485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:43.637712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:43.648101 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:43.648825 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:43.653792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:43.655294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:43.656489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b4c9ebb2-ae9c-401d-890b-689f377a7f3e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1752 microversion: 2.20 time: 0.251555 Aug 23 16:45:43.664054 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:43.665476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:43.665653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 396/776] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:43 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1752 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:43.666252 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:43.667089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:43.667440 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:43.667871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:43.829232 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:43.831849 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e54629e2-ef93-4108-87ac-63d0c1de0906 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1656 microversion: 2.1 time: 0.187444 Aug 23 16:45:43.832458 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 381/777] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:43 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1656 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:45:43.854137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-359fbb62-aa22-4994-bad1-d4c758093868 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:45:43.867513 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-359fbb62-aa22-4994-bad1-d4c758093868 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:43.868357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-359fbb62-aa22-4994-bad1-d4c758093868 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:43.868753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-359fbb62-aa22-4994-bad1-d4c758093868 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:43.895197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-359fbb62-aa22-4994-bad1-d4c758093868 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Going to try to start instance {{(pid=133198) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 16:45:44.090699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-359fbb62-aa22-4994-bad1-d4c758093868 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/action" status: 202 len: 0 microversion: 2.1 time: 0.240965 Aug 23 16:45:44.091312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 397/778] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:45:43 2022] POST /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:45:44.110673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:44.111763 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:44.118973 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:44.119555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:44.120139 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:44.121048 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:44.121735 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:44.122360 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:44.143690 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:44.144641 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:44.151385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:44.151861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:44.152484 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:44.153197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:44.153655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:44.154081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:44.332697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:44.337644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:44.341280 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-65d0b86a-a36e-44ab-b4bf-de85fe20283f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1665 microversion: 2.1 time: 0.243927 Aug 23 16:45:44.341863 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 382/779] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:44 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1665 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:44.345984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ddb52281-8bf9-4135-83c4-ac97554a7985 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.206703 Aug 23 16:45:44.346705 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 398/780] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:44 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:45:44.678858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:44.679496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:44.686368 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:44.686843 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:44.687271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:44.687951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:44.688503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:44.688924 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:44.817555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:44.826953 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:44.828476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:44.829638 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-213b1a78-e1e2-43d7-9a25-b2b8f5a598f1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.154676 Aug 23 16:45:44.830209 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 383/781] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:44 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:45.363989 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:45.364834 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:45.366561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:45.367177 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:45.372252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:45.372845 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:45.373290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:45.373407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:45.373775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:45.374081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:45.374213 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:45.374579 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:45.374908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:45.375019 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:45.375364 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:45.375788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:45.674605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:45.683286 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cb087af1-eae8-4e71-8111-0e53365846d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1665 microversion: 2.1 time: 0.324307 Aug 23 16:45:45.683826 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:45.684389 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 399/782] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:45 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1665 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:45.694460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f8717e6b-4297-41de-b85e-330904daebec tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.331649 Aug 23 16:45:45.695325 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 384/783] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:45 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:45:45.851891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:45.852548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:45.858670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:45.859152 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:45.859588 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:45.860331 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:45.860779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:45.861199 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:46.000006 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:46.006162 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:46.007912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:46.010126 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c8570060-300a-4b82-950b-7c3c7f68bb7b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.161722 Aug 23 16:45:46.010385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 400/784] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:45 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:46.704703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:46.705318 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:46.712245 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:46.712735 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:46.713199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:46.713896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:46.714628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:46.714756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:46.715154 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:46.715347 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:46.722182 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:46.722662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:46.723150 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:46.723842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:46.724322 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:46.724744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:46.919290 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:46.923718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:46.928395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c29e26e1-c7ed-477b-875e-513f743ec41f tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1669 microversion: 2.1 time: 0.227544 Aug 23 16:45:46.929255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 385/785] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:46 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1669 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:46.933218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c4e09e9c-ccbf-4ad1-bf26-34ab883b06e0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.222394 Aug 23 16:45:46.934140 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 401/786] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:46 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:45:47.034047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:47.034667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:47.041882 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.042439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.042881 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.043693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.044281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.044728 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.047385 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cf04009d-25b0-422f-bd5b-fa907ccf94b6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:47.047876 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-cf04009d-25b0-422f-bd5b-fa907ccf94b6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:47.053813 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cf04009d-25b0-422f-bd5b-fa907ccf94b6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.056340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cf04009d-25b0-422f-bd5b-fa907ccf94b6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.056340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cf04009d-25b0-422f-bd5b-fa907ccf94b6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.056340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cf04009d-25b0-422f-bd5b-fa907ccf94b6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.056340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cf04009d-25b0-422f-bd5b-fa907ccf94b6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.056743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cf04009d-25b0-422f-bd5b-fa907ccf94b6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.079210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cf04009d-25b0-422f-bd5b-fa907ccf94b6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b/ips" status: 200 len: 150 microversion: 2.1 time: 0.149131 Aug 23 16:45:47.079780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 386/787] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:45:46 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b/ips => generated 150 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:45:47.091489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d8ca808-4015-4b24-828c-0c5a9bc30485"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:45:47.093903 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:47.100717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.101206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.101644 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.102893 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.103345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.103765 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.190833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Invalid volume: volume 1d8ca808-4015-4b24-828c-0c5a9bc30485 is already attached to instances: e652ad27-aa55-41e5-ba8e-5110c204c128 Aug 23 16:45:47.192490 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: POST /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b/os-volume_attachments HTTP/1.1 Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 74 Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:45:47.192802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {"volumeAttachment": {"volumeId": "1d8ca808-4015-4b24-828c-0c5a9bc30485"}} Aug 23 16:45:47.194402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Invalid volume: volume 1d8ca808-4015-4b24-828c-0c5a9bc30485 is already attached to instances: e652ad27-aa55-41e5-ba8e-5110c204c128 Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'server_id': '7187ddca-2154-4ba6-be64-927f9e0c486b', 'body': {'volumeAttachment': {'volumeId': '1d8ca808-4015-4b24-828c-0c5a9bc30485'}}} Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1d8ca808-4015-4b24-828c-0c5a9bc30485 is already attached to instances: e652ad27-aa55-41e5-ba8e-5110c204c128 Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:45:47.195347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1d8ca808-4015-4b24-828c-0c5a9bc30485 is already attached to instances: e652ad27-aa55-41e5-ba8e-5110c204c128 Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:45:47.198067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:45:47.201463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:45:47.201463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:45:47.201463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:45:47.201463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1d8ca808-4015-4b24-828c-0c5a9bc30485 is already attached to instances: e652ad27-aa55-41e5-ba8e-5110c204c128 Aug 23 16:45:47.201463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:45:47.201463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 400 to user: Invalid volume: volume 1d8ca808-4015-4b24-828c-0c5a9bc30485 is already attached to instances: e652ad27-aa55-41e5-ba8e-5110c204c128 {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:45:47.201463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0460f761-6c97-4735-a5d9-bb3787046052 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106667 Aug 23 16:45:47.201463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 387/788] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:45:47 2022] POST /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 16:45:47.203744 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:47.204285 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:47.211268 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:47.212009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.212407 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.213083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.213994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.214237 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:47.214929 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.215515 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-51750578-3dbd-445a-b1b4-d6adea99c001 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.185419 Aug 23 16:45:47.215732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.216804 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 402/789] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:47 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:45:47.253822 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:45:47.577884 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e9eccf35-3b4a-4035-bc1d-0421b20bf0ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 204 len: 0 microversion: 2.1 time: 0.377648 Aug 23 16:45:47.582499 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 388/790] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:45:47 2022] DELETE /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:45:47.588561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:47.596084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:47.600621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.601195 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.601644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.602414 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.602873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.603420 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.767334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:47.776861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e040c1fc-e7f5-4300-90e6-ba99b7f5c8f0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.192938 Aug 23 16:45:47.777696 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 403/791] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:47 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:45:47.955237 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:47.955946 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:47.962534 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.969962 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.969962 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:47.969962 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:47.969962 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:47.970339 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:48.110291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:48.119079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3caf864a-cd24-4c4f-83b4-b8311bf5f658 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.168310 Aug 23 16:45:48.119645 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 389/792] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:47 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:48.241067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:48.241588 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:48.250651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:48.251147 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:48.251592 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:48.252362 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:48.252822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:48.253255 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:48.386554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:48.395871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:48.397453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:48.398628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8a82cd74-23d4-424e-aebc-a6cf7b114a80 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.161625 Aug 23 16:45:48.399702 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 404/793] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:48 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:48.798704 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:48.800646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:48.805552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:48.806042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:48.806507 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:48.807163 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:48.807645 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:48.808067 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:48.824449 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:48.950771 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:48.958774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-13343721-df44-44e6-96fd-dc479e3ef710 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.163831 Aug 23 16:45:48.961424 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 390/794] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:48 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:49.140681 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:49.141322 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:49.147905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:49.148385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:49.148826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:49.149526 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:49.149984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:49.150414 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:49.154527 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:49.295490 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:49.303805 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3eee2815-c390-4b8e-bf26-eebc1c985af0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.166989 Aug 23 16:45:49.304619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 405/795] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:49 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:49.424269 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:49.424878 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:49.432803 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:49.433428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:49.433994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:49.434925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:49.435358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:49.435885 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:49.576606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:49.586072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:49.587918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:49.593159 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c0794db3-fe0c-4104-a01d-be7613a760f7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.172652 Aug 23 16:45:49.594029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 391/796] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:49 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:49.982070 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:49.982070 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:49.988663 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:49.989234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:49.989742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:49.990538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:49.991060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:49.991584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:50.136238 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:50.153147 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3e2f008c-9afe-406e-8285-292c03a478a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.176668 Aug 23 16:45:50.155487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 406/797] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:49 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:50.326809 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:50.327647 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:50.334199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:50.334682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:50.335117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:50.335821 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:50.336347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:50.337279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:50.473334 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:50.481983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8c6832e1-8258-4c9d-aebf-8ae37dcdabfb tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.160163 Aug 23 16:45:50.482772 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 392/798] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:50 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:50.617093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:50.618266 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:50.624374 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:50.624862 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:50.625336 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:50.626055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:50.626568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:50.627708 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:50.774984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:50.783930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:50.785553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:50.786787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ed17f5eb-be34-4833-80d7-f141234f8190 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.173685 Aug 23 16:45:50.787371 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 407/799] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:50 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:45:51.181880 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:51.182496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:51.188737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:51.189226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:51.189663 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:51.190360 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:51.190819 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:51.191239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:51.334421 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:51.344191 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c1aab6f1-1cfd-4ccd-9b0d-03a0bc8deba7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.166667 Aug 23 16:45:51.344792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 393/800] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:51 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:51.520667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:51.521378 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:51.529768 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:51.530269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:51.530719 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:51.531555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:51.531940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:51.532443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:51.679223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:51.688523 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4ecbb59c-836f-4bd2-b849-d73bde4228e5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.171631 Aug 23 16:45:51.689472 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 408/801] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:51 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:51.809853 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:51.810377 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:51.817041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:51.817608 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:51.818095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:51.818788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:51.819234 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:51.819674 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:51.966779 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:51.977712 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:51.979263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:51.981239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6168d9c6-dbdd-49bf-b96d-3ad99ec96d64 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.174760 Aug 23 16:45:51.981732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 394/802] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:51 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:52.367195 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:52.368269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:52.374254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:52.374741 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:52.375181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:52.375878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:52.376365 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:52.376791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:52.516948 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:52.525161 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1f5175f0-975f-48d8-a57e-5e980ec0bd50 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.161866 Aug 23 16:45:52.525908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 409/803] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:52 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:52.709675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:52.710525 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:52.716510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:52.716993 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:52.717428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:52.718114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:52.718565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:52.718985 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:52.866163 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:52.875750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9c9a4e60-fbe6-467f-a38a-9e01a5b5c530 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.169855 Aug 23 16:45:52.876711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 395/804] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:52 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:53.004499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:53.005271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:53.007597 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=66 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:53.012984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:53.013558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:53.014119 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:53.015001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:53.015589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:53.016087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:53.176608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:53.281905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:53.281905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:53.281905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4e2ff193-a905-4ee0-98b2-13e80e2968ea tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.191059 Aug 23 16:45:53.282292 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 410/805] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:52 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:53.546956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:53.547670 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:53.554516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:53.555043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:53.555544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:53.556196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:53.556653 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:53.557075 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:53.697143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:53.705102 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-dae5ab46-72e3-4c55-ba9f-ae689c6fe64c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.162087 Aug 23 16:45:53.706057 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 396/806] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:53 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:53.901660 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:53.902259 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:53.909637 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:53.910124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:53.910569 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:53.911367 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:53.911829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:53.912441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:54.062080 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:54.073780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-249da2b1-cdda-4559-a0d4-b607d40a13d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.174148 Aug 23 16:45:54.075163 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 411/807] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:53 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:54.237894 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:54.238478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:54.240805 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:45:54.246152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:54.246636 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:54.247075 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:54.247772 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:54.248297 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:54.255302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:54.387159 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:54.396121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:54.397637 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:54.398799 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c69f65fe-3220-47b4-ad18-b98b5473f133 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.164936 Aug 23 16:45:54.404992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 397/808] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:54 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:54.730175 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:54.731642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:54.741156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:54.742135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:54.743483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:54.744774 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:54.745665 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:54.746480 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:54.938419 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:54.946237 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-72f9c349-2108-41fc-a3cb-b24737523397 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.223130 Aug 23 16:45:54.946835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 412/809] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:54 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:55.095210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:55.096188 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:55.103650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:55.103856 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:55.104564 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:55.105065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:55.105650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:55.111086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:55.249690 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:55.258861 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bc435587-8f1c-4119-907d-350f3ca62f27 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.167856 Aug 23 16:45:55.259446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 398/810] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:55 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:55.422106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:55.422886 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:55.430368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:55.431063 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:55.431607 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:55.432442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:55.432971 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:55.433477 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:55.578409 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:55.587412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:55.589075 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:55.590602 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4f4ace55-83aa-4a97-97f9-9a421a2a3638 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.172861 Aug 23 16:45:55.593824 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 413/811] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:55 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:55.967043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:55.967660 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:55.973691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:55.974173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:55.974609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:55.975302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:55.975758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:55.976211 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:56.140806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:56.148894 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7d8d0110-f931-4429-ab7b-89eb387a6aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.185627 Aug 23 16:45:56.149670 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 399/812] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:55 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:56.280670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:56.281442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:56.287668 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:56.288155 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:56.288615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:56.289986 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:56.290447 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:56.290912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:56.422062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:56.430475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dd928e27-664c-4758-ae7b-9aedee522f9d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.153681 Aug 23 16:45:56.431055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 414/813] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:56 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:56.615391 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:56.616061 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:56.622536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:56.623020 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:56.623459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:56.624153 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:56.624633 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:56.625053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:56.759618 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:56.768405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:56.769946 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:56.771114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2b0cfbcc-9818-4cec-b645-429ffd79175c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.159682 Aug 23 16:45:56.771683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 400/814] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:56 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:57.170351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:57.170886 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:57.177535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:57.178027 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:57.178539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:57.179246 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:57.179704 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:57.180699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:57.310700 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:57.318598 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d0b93fb0-ad4d-4a75-ad07-32ff9f886f69 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.152372 Aug 23 16:45:57.319172 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 415/815] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:57 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:57.450921 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:57.451500 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:57.457582 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:57.458065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:57.458501 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:57.459187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:57.459642 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:57.460065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:57.589869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:57.598208 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6da619a4-8c04-4965-be2d-c1a73a8550a0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.151152 Aug 23 16:45:57.598776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 401/816] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:57 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:57.794780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:57.795397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:57.801580 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:57.802068 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:57.802511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:57.803204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:57.803661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:57.804092 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:57.932455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:57.942336 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:57.944056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:57.945271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6dfe4246-5b62-4c0f-8c02-3a8b1fe27126 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.154441 Aug 23 16:45:57.945843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 416/817] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:57 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:58.340903 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:58.341532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:58.348185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:58.348678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:58.349105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:58.349783 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:58.350227 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:58.350646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:58.478184 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:58.486154 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d14b479f-4c5a-43d0-96f8-09ce80bcf1fa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.149790 Aug 23 16:45:58.486723 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 402/818] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:58 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:58.619407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:58.619982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:58.626424 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:58.626903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:58.627339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:58.628031 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:58.628512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:58.628940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:58.759609 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:58.767710 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d0a3c6b3-dd75-4e25-86f8-69fefeb2dc93 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.152258 Aug 23 16:45:58.768305 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 417/819] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:58 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:58.977792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:58.977792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:58.977792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:58.977792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:58.978309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:58.978309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:58.978309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:58.978309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:59.104240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:59.113127 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:59.114622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:59.115776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-25656b59-21b9-4a47-b771-f5447bf6ac70 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.151609 Aug 23 16:45:59.116356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 403/820] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:45:58 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:45:59.506910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:59.507520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:59.514199 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:59.514683 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:59.515122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:59.515824 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:59.516312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:59.516741 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:59.648007 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:59.655647 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cfc0f8e2-4ea2-45e1-8cf5-1fdedecaa423 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.152727 Aug 23 16:45:59.656225 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 418/821] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:59 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:45:59.789962 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:45:59.790563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:45:59.797001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:59.797474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:59.797899 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:59.798574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:45:59.799053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:45:59.799471 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:45:59.927272 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:45:59.936233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ef1d0601-6cca-416f-a668-6deb512a9bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.150541 Aug 23 16:45:59.936806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 404/822] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:45:59 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:00.138680 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:00.139255 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:00.145113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:00.145594 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:00.146144 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:00.146839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:00.147288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:00.147714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:00.279751 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:00.288263 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:00.290423 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:00.291574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c9eeebeb-fff3-4b3f-a59f-1d2bce734234 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.156856 Aug 23 16:46:00.292128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 419/823] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:00 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:46:00.676151 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:00.676785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:00.682722 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:00.683198 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:00.683625 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:00.684331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:00.684783 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:00.685200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:00.815590 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:00.823836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-03245a93-8aa8-4afd-8b81-4559898c884a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.151721 Aug 23 16:46:00.824441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 405/824] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:00 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:00.957665 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:00.958203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:00.964958 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:00.966967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:00.966967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:00.966967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:00.967268 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:00.967428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:01.094471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:01.103109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e5777f92-4359-4bae-afe9-8f8a88be3b6d tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.149349 Aug 23 16:46:01.103676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 420/825] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:00 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:46:01.314975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:01.315588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:01.325633 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:01.326130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:01.326560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:01.327254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:01.327715 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:01.328134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:01.460442 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:01.469568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:01.471050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:01.472235 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9351ef57-0709-4122-b04d-03c7d67475eb tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.161386 Aug 23 16:46:01.472790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 406/826] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:01 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:46:01.844931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:01.845548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:01.851456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:01.852638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:01.853115 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:01.853807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:01.854263 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:01.854721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:01.983617 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:01.987048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:01.991557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-793bf9e6-3362-4a12-9ac2-e53c38b5771b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.150663 Aug 23 16:46:01.992126 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 421/827] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:01 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:02.124385 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:02.125000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:02.131369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:02.131850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:02.132313 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:02.133514 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:02.133965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:02.134384 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:02.136942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:02.274080 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:02.282492 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0222f3ce-82f1-4a9a-8227-2af586cfebea tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.161959 Aug 23 16:46:02.283326 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 407/828] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:02 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:02.497122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:02.497674 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:02.503963 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:02.504489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:02.504943 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:02.505653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:02.506113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:02.506545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:02.642517 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:02.652350 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:02.653854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:02.655033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e5d20417-7f11-4948-bc90-64d7a0ac0ac8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.162847 Aug 23 16:46:02.655595 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 422/829] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:02 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:46:03.012723 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:03.013336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:03.020213 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:03.020915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:03.021520 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:03.022218 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:03.022666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:03.023167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:03.240832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:03.249044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-34555f8f-f7c7-4a31-9892-815a2967c6e9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1682 microversion: 2.1 time: 0.240147 Aug 23 16:46:03.249648 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 408/830] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:03 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1682 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:03.304596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:03.305234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:03.312076 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:03.312602 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:03.313042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:03.313786 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:03.314247 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:03.314673 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:03.678562 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:03.679229 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:03.685321 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:03.685766 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:03.686204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:03.686898 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:03.687351 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:03.687773 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:03.724152 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:03.732638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d6585e6e-5a5b-4c39-9d84-b364253963d9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.432012 Aug 23 16:46:03.733219 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 423/831] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:03 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:03.913597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:03.922477 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:03.924054 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:03.925250 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5dd72692-76fe-4a10-9a6e-48e2216c0bad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.250578 Aug 23 16:46:03.925814 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 409/832] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:03 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:46:04.269883 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:04.270616 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:04.276711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:04.277275 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:04.277725 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:04.278426 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:04.278885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:04.279313 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:04.353185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:04.362791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-61e233d1-b28a-44bb-9583-b20ec57d3b8a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1614 microversion: 2.1 time: 0.096757 Aug 23 16:46:04.363366 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 424/833] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:04 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:04.497877 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-36db381e-8ece-4d08-8e7d-aaf5d9461ceb req-21769586-85d8-4a62-8e2c-25ad0692d26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7187ddca-2154-4ba6-be64-927f9e0c486b", "name": "network-vif-deleted", "tag": "26e738ac-fe55-4c06-b907-5a97c243bba5"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:04.507422 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-36db381e-8ece-4d08-8e7d-aaf5d9461ceb req-21769586-85d8-4a62-8e2c-25ad0692d26c service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:04.507935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-36db381e-8ece-4d08-8e7d-aaf5d9461ceb req-21769586-85d8-4a62-8e2c-25ad0692d26c service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:04.508395 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-36db381e-8ece-4d08-8e7d-aaf5d9461ceb req-21769586-85d8-4a62-8e2c-25ad0692d26c service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:04.520366 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-36db381e-8ece-4d08-8e7d-aaf5d9461ceb req-21769586-85d8-4a62-8e2c-25ad0692d26c service nova] Creating event network-vif-deleted:26e738ac-fe55-4c06-b907-5a97c243bba5 for instance 7187ddca-2154-4ba6-be64-927f9e0c486b on hv-cinder-85032 Aug 23 16:46:04.526104 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-36db381e-8ece-4d08-8e7d-aaf5d9461ceb req-21769586-85d8-4a62-8e2c-25ad0692d26c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089484 Aug 23 16:46:04.526710 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 410/834] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:04.754743 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:04.755737 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:04.763637 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:04.764388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:04.765401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:04.766587 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:04.767284 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:04.768219 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:04.951135 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:04.952850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:04.962612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:04.963436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:04.964094 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:04.965138 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:04.965793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:04.966443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:04.993615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:05.004937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a4c0ca11-ef13-4710-b6ed-e0d4734a1c2a tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.253809 Aug 23 16:46:05.020681 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 425/835] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:04 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:05.122443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:05.131300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:05.133306 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:05.134685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a4ffa356-76a6-4bc6-b7e3-ec995e2ec804 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.189736 Aug 23 16:46:05.135241 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 411/836] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:04 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:46:05.385745 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:05.386694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:05.393795 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:05.394372 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:05.394895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:05.395678 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:05.396281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:05.396909 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:05.444552 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:05.445290 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:05.446362 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:05.446892 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lazy-loading 'fault' on Instance uuid 7187ddca-2154-4ba6-be64-927f9e0c486b {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:46:05.494114 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:05.504978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2bbc7ee2-af9a-43fc-bf3c-628ba82b318d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1331 microversion: 2.1 time: 0.121002 Aug 23 16:46:05.504978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 426/837] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:05 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:06.027519 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:06.028294 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:06.034868 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:06.035437 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:06.035937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:06.036664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:06.037111 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:06.037529 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:06.158940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:06.159584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:06.166254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:06.166881 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:06.167162 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:06.167859 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:06.168341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:06.168766 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:06.169775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:06.178374 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9a502cee-e797-4793-9d2c-026ddd58e033 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1736 microversion: 2.1 time: 0.155255 Aug 23 16:46:06.178954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 412/838] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:06 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:06.299428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:06.308219 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:06.309723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:06.310883 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-22bfadde-53e3-496a-a59b-4859aebdc650 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.155851 Aug 23 16:46:06.311442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 427/839] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:06 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:46:06.524727 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:06.525337 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:06.531254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:06.531765 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:06.532221 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:06.532914 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:06.533361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:06.533782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:06.564371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:06.564779 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:06.565207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:06.565663 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lazy-loading 'fault' on Instance uuid 7187ddca-2154-4ba6-be64-927f9e0c486b {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:46:06.620007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:06.629420 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4677157e-0e05-4fdf-a50b-fe500549baaa tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 200 len: 1331 microversion: 2.1 time: 0.110085 Aug 23 16:46:06.630385 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 413/840] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:06 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:07.199380 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:07.199995 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:07.206669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.207155 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.207598 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.208417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.208882 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.209394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.340043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:07.340711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:07.340980 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:07.347212 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.347689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.348114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.349392 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.349392 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.349614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bf8ac536-06a3-4a94-a0a0-239110efbc56 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1716 microversion: 2.1 time: 0.154326 Aug 23 16:46:07.349718 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.349937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 428/841] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:07 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:07.412475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:07.413299 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:07.419027 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.419519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.419952 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.420675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.421125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.421550 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.487147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:07.496780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:07.498331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:07.499510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e89723ca-2cd9-45fa-9ebd-b0838dc42d18 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.163930 Aug 23 16:46:07.500081 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 414/842] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:07 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:46:07.523973 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] HTTP exception thrown: Cannot 'detach_volume' instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f while it is in vm_state rescued Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Request method failure captured: Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: DELETE /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments/5b9a386a-077b-4100-90f3-4fd03534ad7b HTTP/1.1 Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKYblaySY69o3r67kZXBryao_JDz8ISrivQ4koxsrmPtheZvDHuaJfkPKyTtGzAPMTZ0C_nBLI8kFRTmhFlEKYQNhz9rpsAUQn2twU4r9ydG41I-t1EJaMk29PXKgrUhqFvE6UV4XUsrtUpM3-SncpZB3kDhTQxJcVSY8_WbTBR_cM Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:46:07.525662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_102f835e0f424477aab1d540a2a15d22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 50c9a90fabc0466988ed6bae32beb47f Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:46:07.527241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Cannot 'detach_volume' instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f while it is in vm_state rescued Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'server_id': '0de441a4-ffc5-43ff-bf83-faec28f6ed1f', 'id': '5b9a386a-077b-4100-90f3-4fd03534ad7b'} Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:46:07.528055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f while it is in vm_state rescued Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f while it is in vm_state rescued Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.529615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Returning 409 to user: Cannot 'detach_volume' instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f while it is in vm_state rescued {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:46:07.530841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3813ed5a-649c-4160-a827-09cdf3c3c422 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments/5b9a386a-077b-4100-90f3-4fd03534ad7b" status: 409 len: 152 microversion: 2.1 time: 0.118579 Aug 23 16:46:07.530841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 429/843] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:46:07 2022] DELETE /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments/5b9a386a-077b-4100-90f3-4fd03534ad7b => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 23 16:46:07.535987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7bf1c0ce-bab2-48b1-bab1-c6a55101d90c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:07.536551 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7bf1c0ce-bab2-48b1-bab1-c6a55101d90c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:07.542441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7bf1c0ce-bab2-48b1-bab1-c6a55101d90c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.542926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7bf1c0ce-bab2-48b1-bab1-c6a55101d90c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.543362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7bf1c0ce-bab2-48b1-bab1-c6a55101d90c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.544083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7bf1c0ce-bab2-48b1-bab1-c6a55101d90c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.544559 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7bf1c0ce-bab2-48b1-bab1-c6a55101d90c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.545012 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7bf1c0ce-bab2-48b1-bab1-c6a55101d90c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.650947 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:07.651562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:07.657793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.658279 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.658723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.659415 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.659873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.660338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.673728 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b HTTP/1.1 Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:46:07.675252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:46:07.676818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '7187ddca-2154-4ba6-be64-927f9e0c486b'} Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:46:07.677635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:46:07.678839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:07.684376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:46:07.684376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8738d492-547e-4d04-b4c1-2ac0825e75ea tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 404 len: 111 microversion: 2.1 time: 0.029595 Aug 23 16:46:07.684376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 430/844] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:07 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 16:46:07.685500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2cd43681-ed01-436b-861d-bfd5f61e7c4e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '.version_select at 0x7f677c9d2790>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:07.689871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2cd43681-ed01-436b-861d-bfd5f61e7c4e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [11cc7970-bb48-4915-a256-d9e6379c6505] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 16:46:07.798210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7bf1c0ce-bab2-48b1-bab1-c6a55101d90c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "POST /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/action" status: 202 len: 0 microversion: 2.1 time: 0.265792 Aug 23 16:46:07.798848 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 415/845] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:46:07 2022] POST /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:46:07.808826 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:07.809525 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:07.815694 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.816281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.816719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.817408 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:07.817869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:07.818286 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:07.963848 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:07.972308 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a68354af-a573-4d61-a6f3-de8c4d8f9da7 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1724 microversion: 2.1 time: 0.168396 Aug 23 16:46:07.972899 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 416/846] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:07 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:46:08.523349 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:08.524609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:08.531073 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:08.531551 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:08.532019 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:08.532736 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:08.533189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:08.533609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:08.661632 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:08.670258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:08.671742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:08.674789 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d01300a9-0c90-4490-b67b-ca1c814df922 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.153621 Aug 23 16:46:08.674789 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 417/847] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:08 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:46:08.697128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [None req-2cd43681-ed01-436b-861d-bfd5f61e7c4e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [11cc7970-bb48-4915-a256-d9e6379c6505] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 51002. Aug 23 16:46:08.751557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2cd43681-ed01-436b-861d-bfd5f61e7c4e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259670480" status: 202 len: 0 microversion: 2.1 time: 1.069509 Aug 23 16:46:08.752136 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 431/848] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 23 16:46:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259670480 => generated 0 bytes in 1071 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 16:46:08.995125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:08.996476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:09.003101 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:09.003588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:09.004021 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:09.004741 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:09.005194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:09.006208 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:09.246426 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:09.254664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2f5a5bf1-266f-4fc1-9a2b-4b1b8d115c32 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1724 microversion: 2.1 time: 0.263996 Aug 23 16:46:09.255461 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 418/849] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:08 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:09.648099 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:09.648686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:09.655317 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:09.655794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:09.656253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:09.656940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:09.657390 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:09.657819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:09.694917 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:09.695525 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:09.702043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:09.702516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:09.702943 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:09.703639 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:09.704098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:09.704622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:09.741757 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lazy-loading 'services' on Instance uuid e652ad27-aa55-41e5-ba8e-5110c204c128 {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:46:09.924610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:09.933651 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:09.935163 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:09.936416 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a724a88c-b99d-41be-b85c-60ba5cd90630 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.245629 Aug 23 16:46:09.947186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 419/850] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:09 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:46:09.980887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-348f5250-dadf-4e7c-adb8-2dc14f3856c5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments/1d8ca808-4015-4b24-828c-0c5a9bc30485" status: 202 len: 0 microversion: 2.1 time: 0.336699 Aug 23 16:46:09.981997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 432/851] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:46:09 2022] DELETE /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments/1d8ca808-4015-4b24-828c-0c5a9bc30485 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:46:09.995953 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-30d577c8-9ea0-4f4e-a1b9-67a1b4a1fdb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:09.999561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-30d577c8-9ea0-4f4e-a1b9-67a1b4a1fdb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:10.005938 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30d577c8-9ea0-4f4e-a1b9-67a1b4a1fdb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:10.006493 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30d577c8-9ea0-4f4e-a1b9-67a1b4a1fdb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:10.006935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30d577c8-9ea0-4f4e-a1b9-67a1b4a1fdb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:10.008135 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30d577c8-9ea0-4f4e-a1b9-67a1b4a1fdb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:10.008793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30d577c8-9ea0-4f4e-a1b9-67a1b4a1fdb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:10.009221 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-30d577c8-9ea0-4f4e-a1b9-67a1b4a1fdb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:10.042856 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-30d577c8-9ea0-4f4e-a1b9-67a1b4a1fdb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052055 Aug 23 16:46:10.043434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 420/852] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:46:09 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:10.277985 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:10.278685 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:10.284968 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:10.285466 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:10.285889 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:10.286573 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:10.287053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:10.287484 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:10.420665 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:10.428885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bcc684f1-d79c-4d56-b4b0-b1d926dfaabd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1724 microversion: 2.1 time: 0.155845 Aug 23 16:46:10.429458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 433/853] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:10 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:10.959460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:10.960300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:10.966697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:10.967179 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:10.967615 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:10.968375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:10.968835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:10.969258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:11.056484 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-25b79643-974d-413d-b9ec-39f5953c04a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:11.058714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-25b79643-974d-413d-b9ec-39f5953c04a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:11.065278 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25b79643-974d-413d-b9ec-39f5953c04a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:11.065877 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25b79643-974d-413d-b9ec-39f5953c04a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:11.066541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25b79643-974d-413d-b9ec-39f5953c04a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:11.067320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25b79643-974d-413d-b9ec-39f5953c04a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:11.067885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25b79643-974d-413d-b9ec-39f5953c04a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:11.068416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25b79643-974d-413d-b9ec-39f5953c04a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:11.098272 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-25b79643-974d-413d-b9ec-39f5953c04a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046861 Aug 23 16:46:11.099226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 434/854] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:46:11 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:46:11.101240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:11.110890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:11.112443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:11.113646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-506d9608-a174-4aa5-9eab-bd641ba80c90 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.158246 Aug 23 16:46:11.114196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 421/855] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:10 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:46:11.450031 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:11.450649 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:11.456668 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:11.457156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:11.457601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:11.458298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:11.458760 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:11.459191 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:11.594884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:11.603987 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b4dde0cb-c545-44c6-beee-a8b194facd19 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1724 microversion: 2.1 time: 0.157799 Aug 23 16:46:11.604606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 435/856] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:11 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:12.111330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f5464ea2-43bc-4635-bf49-ec7215b1f223 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:12.113552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f5464ea2-43bc-4635-bf49-ec7215b1f223 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:12.120566 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5464ea2-43bc-4635-bf49-ec7215b1f223 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:12.121050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5464ea2-43bc-4635-bf49-ec7215b1f223 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:12.121486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5464ea2-43bc-4635-bf49-ec7215b1f223 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:12.122176 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5464ea2-43bc-4635-bf49-ec7215b1f223 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:12.122625 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5464ea2-43bc-4635-bf49-ec7215b1f223 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:12.123045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5464ea2-43bc-4635-bf49-ec7215b1f223 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:12.137031 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:12.137644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:12.144041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:12.144567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:12.145013 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:12.145715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:12.146176 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:12.146607 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:12.153246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f5464ea2-43bc-4635-bf49-ec7215b1f223 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045840 Aug 23 16:46:12.153815 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 422/857] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:46:12 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:12.275298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:12.283801 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:12.285316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:12.286459 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4a06e7b1-e191-43d2-818d-fc6f24ff3982 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.154095 Aug 23 16:46:12.287003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 436/858] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:12 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:46:12.625759 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:12.626376 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:12.632615 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:12.633097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:12.633589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:12.634300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:12.634773 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:12.635193 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:12.639586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:12.766266 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:12.775015 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-dee93624-92ef-435a-b4e1-c05dc4bd1555 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1724 microversion: 2.1 time: 0.153167 Aug 23 16:46:12.775588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 423/859] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:12 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:13.042669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-df54afdc-e596-4496-b232-e8710d5d7dbb req-631e0acc-ab11-4c38-98cd-6f3551e0b84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8", "name": "network-vif-plugged", "status": "completed", "tag": "e24378e6-7626-4b59-81eb-752fbcca503a"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:13.052071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-df54afdc-e596-4496-b232-e8710d5d7dbb req-631e0acc-ab11-4c38-98cd-6f3551e0b84e service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:13.052636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-df54afdc-e596-4496-b232-e8710d5d7dbb req-631e0acc-ab11-4c38-98cd-6f3551e0b84e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:13.053070 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-df54afdc-e596-4496-b232-e8710d5d7dbb req-631e0acc-ab11-4c38-98cd-6f3551e0b84e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:13.064195 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-df54afdc-e596-4496-b232-e8710d5d7dbb req-631e0acc-ab11-4c38-98cd-6f3551e0b84e service nova] Creating event network-vif-plugged:e24378e6-7626-4b59-81eb-752fbcca503a for instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 on hv-cinder-85032 Aug 23 16:46:13.071454 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-df54afdc-e596-4496-b232-e8710d5d7dbb req-631e0acc-ab11-4c38-98cd-6f3551e0b84e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032443 Aug 23 16:46:13.072036 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 437/860] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:46:13.166140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e5654d4c-af06-4d94-a0d2-d3046d963fbe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:13.168494 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e5654d4c-af06-4d94-a0d2-d3046d963fbe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:13.175703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5654d4c-af06-4d94-a0d2-d3046d963fbe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:13.176211 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5654d4c-af06-4d94-a0d2-d3046d963fbe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:13.176648 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5654d4c-af06-4d94-a0d2-d3046d963fbe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:13.177348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5654d4c-af06-4d94-a0d2-d3046d963fbe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:13.177801 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5654d4c-af06-4d94-a0d2-d3046d963fbe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:13.178228 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5654d4c-af06-4d94-a0d2-d3046d963fbe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:13.208472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e5654d4c-af06-4d94-a0d2-d3046d963fbe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Aug 23 16:46:13.209044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 424/861] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:46:13 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:13.309784 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:13.310501 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:13.316882 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:13.317365 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:13.317809 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:13.318526 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:13.318973 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:13.319397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:13.451220 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:13.459888 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:13.461478 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:13.463195 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b0b7f50d-06fa-4311-8fe3-14400b302ff5 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.158154 Aug 23 16:46:13.463755 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 438/862] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:13 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:46:13.795214 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:13.795870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:13.802549 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:13.803030 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:13.803460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:13.807356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:13.807356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:13.807356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:13.935628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:13.944125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c265f562-1d4d-4f25-9491-5d6f5cada8de tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1730 microversion: 2.1 time: 0.152607 Aug 23 16:46:13.944734 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 425/863] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:13 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:13.965806 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d06c3f28-5a4d-44c8-a6e7-155e32e7ae61 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:13.973561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d06c3f28-5a4d-44c8-a6e7-155e32e7ae61 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:13.973561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d06c3f28-5a4d-44c8-a6e7-155e32e7ae61 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:13.973561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d06c3f28-5a4d-44c8-a6e7-155e32e7ae61 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:13.973923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d06c3f28-5a4d-44c8-a6e7-155e32e7ae61 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:13.974732 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d06c3f28-5a4d-44c8-a6e7-155e32e7ae61 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:13.974924 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d06c3f28-5a4d-44c8-a6e7-155e32e7ae61 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:13.975330 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d06c3f28-5a4d-44c8-a6e7-155e32e7ae61 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:14.059939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d06c3f28-5a4d-44c8-a6e7-155e32e7ae61 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098006 Aug 23 16:46:14.060577 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 439/864] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 23 16:46:13 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:46:14.222329 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9cb5fe93-8b7e-41d5-95b0-aa25a3713d99 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:14.225024 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9cb5fe93-8b7e-41d5-95b0-aa25a3713d99 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:14.232891 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cb5fe93-8b7e-41d5-95b0-aa25a3713d99 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:14.233599 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cb5fe93-8b7e-41d5-95b0-aa25a3713d99 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:14.234157 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cb5fe93-8b7e-41d5-95b0-aa25a3713d99 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:14.234942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cb5fe93-8b7e-41d5-95b0-aa25a3713d99 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:14.236007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cb5fe93-8b7e-41d5-95b0-aa25a3713d99 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:14.236466 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9cb5fe93-8b7e-41d5-95b0-aa25a3713d99 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:14.267578 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9cb5fe93-8b7e-41d5-95b0-aa25a3713d99 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049965 Aug 23 16:46:14.268414 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 426/865] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:46:14 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 16:46:14.330468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:14.331049 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:14.338075 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:14.338572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:14.339017 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:14.339732 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:14.340221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:14.340651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:14.345391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:14.368978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Going to try to terminate instance {{(pid=133198) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:46:14.486411 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:14.487271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:14.493476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:14.493955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:14.494382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:14.495077 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:14.495522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:14.495938 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:14.670999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3455e47b-dbd6-43ad-9353-41c7c340a045 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 204 len: 0 microversion: 2.1 time: 0.344540 Aug 23 16:46:14.671718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 440/866] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:46:14 2022] DELETE /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:46:14.680538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:14.681378 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:14.687541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:14.688128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:14.688672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:14.689474 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:14.689989 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:14.690418 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:14.833964 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:14.843319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:14.844858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:14.846026 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8fd17a9b-f689-4ff8-bc33-f750fa6afaae tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.363725 Aug 23 16:46:14.846594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 427/867] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:14 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:46:14.971235 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:14.979229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-850d1d5c-5222-47fd-9087-ec068a9782d0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1682 microversion: 2.1 time: 0.302957 Aug 23 16:46:14.979807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 441/868] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:14 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1682 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:15.457949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-16d8779d-0e69-46de-a10f-b606825fede1 req-fc8c3097-dab1-4db9-8e6e-ffcbeb13c212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de441a4-ffc5-43ff-bf83-faec28f6ed1f", "tag": "a6f566e4-5cdd-45cb-b319-5370499e6059"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:15.468864 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-16d8779d-0e69-46de-a10f-b606825fede1 req-fc8c3097-dab1-4db9-8e6e-ffcbeb13c212 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:15.469347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-16d8779d-0e69-46de-a10f-b606825fede1 req-fc8c3097-dab1-4db9-8e6e-ffcbeb13c212 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:15.469780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-16d8779d-0e69-46de-a10f-b606825fede1 req-fc8c3097-dab1-4db9-8e6e-ffcbeb13c212 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:15.481482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-16d8779d-0e69-46de-a10f-b606825fede1 req-fc8c3097-dab1-4db9-8e6e-ffcbeb13c212 service nova] Creating event network-changed:a6f566e4-5cdd-45cb-b319-5370499e6059 for instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f on hv-cinder-85032 Aug 23 16:46:15.487037 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-16d8779d-0e69-46de-a10f-b606825fede1 req-fc8c3097-dab1-4db9-8e6e-ffcbeb13c212 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032932 Aug 23 16:46:15.487965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 428/869] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:46:15.870848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:15.871471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:15.878154 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:15.878650 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:15.879081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:15.879781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:15.880258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:15.880823 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:16.005730 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:16.007053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:16.014738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:16.015230 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:16.015668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:16.016403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:16.016861 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:16.020276 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:16.022240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:16.029565 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:16.031566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:16.033063 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-25f9e00a-f7ce-431a-a4c2-f68915aea534 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.168142 Aug 23 16:46:16.034170 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 442/870] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:15 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:46:16.167545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:16.175508 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a91bbf70-061c-464d-8a5f-fb8476d89e9a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1682 microversion: 2.1 time: 0.176679 Aug 23 16:46:16.176099 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 429/871] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:15 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:46:17.057287 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:17.061113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:17.064835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:17.065320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:17.065758 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:17.066450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:17.066899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:17.067329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:17.199063 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:17.200387 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:17.207313 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:17.207830 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:17.208295 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:17.209001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:17.209457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:17.210059 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:17.235507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:17.245443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:17.247331 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:17.248719 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ef5ab1db-93b3-4b80-9050-de7c160fe7c8 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.195391 Aug 23 16:46:17.249505 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 443/872] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:17 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:46:17.281175 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:17.290190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ed6a0d6c-1fcf-43b2-b808-e6a58b276722 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1614 microversion: 2.1 time: 0.094712 Aug 23 16:46:17.290763 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 430/873] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:17 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:46:17.504991 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-fa02cb79-ef2a-48ef-94d7-68a420ad05d7 req-7745fa50-1cd3-4168-a8c5-bb207138dfbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de441a4-ffc5-43ff-bf83-faec28f6ed1f", "tag": "a6f566e4-5cdd-45cb-b319-5370499e6059"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:17.536488 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-a7df1173-c5a2-4af7-a26b-4e917b076521 req-939d7e73-a017-4c13-8e72-375dde46445b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e652ad27-aa55-41e5-ba8e-5110c204c128", "name": "network-vif-deleted", "tag": "ea460abd-9103-4311-9677-c18e10db6641"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:17.536832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-fa02cb79-ef2a-48ef-94d7-68a420ad05d7 req-7745fa50-1cd3-4168-a8c5-bb207138dfbc service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:17.536832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-fa02cb79-ef2a-48ef-94d7-68a420ad05d7 req-7745fa50-1cd3-4168-a8c5-bb207138dfbc service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:17.536832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-fa02cb79-ef2a-48ef-94d7-68a420ad05d7 req-7745fa50-1cd3-4168-a8c5-bb207138dfbc service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:17.547029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-a7df1173-c5a2-4af7-a26b-4e917b076521 req-939d7e73-a017-4c13-8e72-375dde46445b service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:17.547874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-a7df1173-c5a2-4af7-a26b-4e917b076521 req-939d7e73-a017-4c13-8e72-375dde46445b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:17.548433 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-fa02cb79-ef2a-48ef-94d7-68a420ad05d7 req-7745fa50-1cd3-4168-a8c5-bb207138dfbc service nova] Creating event network-changed:a6f566e4-5cdd-45cb-b319-5370499e6059 for instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f on hv-cinder-85032 Aug 23 16:46:17.549402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-a7df1173-c5a2-4af7-a26b-4e917b076521 req-939d7e73-a017-4c13-8e72-375dde46445b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:17.554619 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-fa02cb79-ef2a-48ef-94d7-68a420ad05d7 req-7745fa50-1cd3-4168-a8c5-bb207138dfbc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055754 Aug 23 16:46:17.555579 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 431/874] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:17.575356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-a7df1173-c5a2-4af7-a26b-4e917b076521 req-939d7e73-a017-4c13-8e72-375dde46445b service nova] Creating event network-vif-deleted:ea460abd-9103-4311-9677-c18e10db6641 for instance e652ad27-aa55-41e5-ba8e-5110c204c128 on hv-cinder-85032 Aug 23 16:46:17.580880 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-a7df1173-c5a2-4af7-a26b-4e917b076521 req-939d7e73-a017-4c13-8e72-375dde46445b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159909 Aug 23 16:46:17.581800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 444/875] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:18.272269 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:18.272977 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:18.280373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:18.281129 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:18.281567 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:18.282271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:18.282813 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:18.283134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:18.315699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:18.316519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:18.327790 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:18.328687 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:18.329141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:18.329874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:18.330341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:18.330778 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:18.368251 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:18.368758 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:18.369381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:18.370568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lazy-loading 'fault' on Instance uuid e652ad27-aa55-41e5-ba8e-5110c204c128 {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:46:18.424716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:18.435388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c5b1e7b3-0358-4931-843d-815c067c1841 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 200 len: 1332 microversion: 2.1 time: 0.124195 Aug 23 16:46:18.436268 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 445/876] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:18 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:46:18.455845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:18.465585 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:18.467339 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:18.468640 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5789f139-736e-4e03-a966-1de54da6112f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1808 microversion: 2.20 time: 0.201360 Aug 23 16:46:18.469288 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 432/877] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:18 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:46:19.457087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:19.457696 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:19.464810 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:19.465289 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:19.465722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:19.466416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:19.466867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:19.467288 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:19.480520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 HTTP/1.1 Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:46:19.482398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:46:19.483887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'e652ad27-aa55-41e5-ba8e-5110c204c128'} Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:46:19.484868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:46:19.486236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:46:19.487516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:46:19.487516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bdd0e88d-6a47-40ae-8999-fe18432ceba2 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 404 len: 111 microversion: 2.1 time: 0.030553 Aug 23 16:46:19.487516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 446/878] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:19 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:46:19.493003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d24fd862-3d07-4774-b6e8-0a2bc2e6814e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '.version_select at 0x7f67782775e0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:19.493190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:19.493796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:19.500443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:19.500924 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:19.501348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:19.502037 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:19.502480 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:19.502895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:19.558448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d24fd862-3d07-4774-b6e8-0a2bc2e6814e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614556171" status: 202 len: 0 microversion: 2.1 time: 0.069669 Aug 23 16:46:19.559019 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 447/879] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 23 16:46:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614556171 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:46:19.640598 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:19.649570 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:19.650837 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:19.652002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-93784e22-9682-438a-ad64-9e59acd219ec tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1795 microversion: 2.20 time: 0.163494 Aug 23 16:46:19.652601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 433/880] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:46:19 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1795 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:46:20.395023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e0aba877-1e7c-4e5c-b6cc-7eaa7f7b0249 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: .version_select at 0x7f677c95ae50>, body: {"keypair": {"name": "tempest-keypair-351151624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANavIIraNgJeqC5cUfqxnPbCFiWACuhNO48GWuR397PHbSYbaRiapUVJoCqdqMhS8nY+NKJ3GPirik/8eVmxcMtB+yrENKIjKy8feWYhKoaHQeXLzQhvETUpVBAqEYSLQ=="}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:20.411404 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-e0aba877-1e7c-4e5c-b6cc-7eaa7f7b0249 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:46:20.415865 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-e0aba877-1e7c-4e5c-b6cc-7eaa7f7b0249 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for user a642d26e91c8449296a7a6733221824f and project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:46:20.430689 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:20.538598 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e0aba877-1e7c-4e5c-b6cc-7eaa7f7b0249 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147488 Aug 23 16:46:20.539304 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 448/881] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:46:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:23.129549 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1746893760", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8232e7cf-7851-4756-8389-6e87e5a21279"}], "security_groups": [{"name": "tempest-securitygroup--1586836988"}], "key_name": "tempest-keypair-351151624", "user_data": "}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:23.233323 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] validate_networks() for [('8232e7cf-7851-4756-8389-6e87e5a21279', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:46:23.600824 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:46:23.601255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:46:23.601730 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:46:23.602144 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:46:23.602555 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:46:23.612256 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:23.612733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:23.613171 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:23.613894 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:23.614346 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:23.614767 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:23.632510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:46:23.636911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for user a642d26e91c8449296a7a6733221824f and project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:46:23.648865 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:46:23.651162 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:46:23.813822 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0d9e1717-ed84-45be-95e4-36cce359add4 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.688371 Aug 23 16:46:23.814382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 434/882] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:46:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:46:23.825914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-95929e3c-727f-48bd-a579-233d29b5b8f7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:23.826646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-95929e3c-727f-48bd-a579-233d29b5b8f7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:23.886357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-95929e3c-727f-48bd-a579-233d29b5b8f7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:23.894451 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-95929e3c-727f-48bd-a579-233d29b5b8f7 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1241 microversion: 2.1 time: 0.072777 Aug 23 16:46:23.895060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 449/883] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:23 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:46:24.920074 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:24.920677 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:24.922694 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:24.928381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:24.934869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:24.934869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:24.934869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:24.934869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:24.935242 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:24.994127 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:25.000189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-62e7984d-175a-4896-836a-fbd99e23dbb3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1245 microversion: 2.1 time: 0.084782 Aug 23 16:46:25.000758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 435/884] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:24 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:26.021513 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:26.022250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:26.028614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:26.029104 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:26.029576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:26.030280 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:26.030759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:26.031172 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:26.095737 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:26.104002 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cabcf8b3-e5c3-4b48-94cc-2042f4db9aa1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1293 microversion: 2.1 time: 0.086508 Aug 23 16:46:26.104604 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 450/885] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:26 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:27.125462 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:27.126250 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:27.133602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:27.135140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:27.135800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:27.136925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:27.137542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:27.138122 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:27.272432 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:27.280489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-095e8bec-fe70-4ef1-9eb4-bbd5311e7362 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.158989 Aug 23 16:46:27.281063 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 436/886] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:27 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:27.903022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-e7a35776-ee1f-4c14-8d99-2b5d612e637d req-7aa4080b-c3c3-472f-81de-0d93fca08790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35678a46-44f2-44f5-87d9-4af40d0b7d32", "tag": "c6fa608b-4c82-4b90-ae75-a59025725505"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:27.912585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e7a35776-ee1f-4c14-8d99-2b5d612e637d req-7aa4080b-c3c3-472f-81de-0d93fca08790 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:27.913051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e7a35776-ee1f-4c14-8d99-2b5d612e637d req-7aa4080b-c3c3-472f-81de-0d93fca08790 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:27.913698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-e7a35776-ee1f-4c14-8d99-2b5d612e637d req-7aa4080b-c3c3-472f-81de-0d93fca08790 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:27.925534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-e7a35776-ee1f-4c14-8d99-2b5d612e637d req-7aa4080b-c3c3-472f-81de-0d93fca08790 service nova] Creating event network-changed:c6fa608b-4c82-4b90-ae75-a59025725505 for instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 on hv-cinder-85032 Aug 23 16:46:27.930403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-e7a35776-ee1f-4c14-8d99-2b5d612e637d req-7aa4080b-c3c3-472f-81de-0d93fca08790 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031659 Aug 23 16:46:27.931015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 451/887] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:28.302029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:28.302640 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:28.309102 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:28.309580 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:28.310016 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:28.310708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:28.311161 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:28.311585 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:28.595315 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:28.603247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-aa42a42b-574b-4341-87e2-6cf7b00eacb6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.305103 Aug 23 16:46:28.603839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 437/888] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:28 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:29.623847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:29.624585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:29.630729 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:29.631217 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:29.631659 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:29.632394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:29.632853 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:29.633292 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:29.762137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:29.769643 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-89b4664d-d19a-4535-a448-d41c7dcfb27e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.150538 Aug 23 16:46:29.770214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 452/889] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:29 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:30.791355 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:30.791959 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:30.798422 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:30.798900 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:30.801832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:30.801832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:30.801832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:30.801832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:30.943920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:30.955496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a8cf7cc4-04e5-487b-aea3-5dc220a1d15e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.168552 Aug 23 16:46:30.956103 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 438/890] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:30 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:31.981286 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:31.982163 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:31.988696 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:31.989178 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:31.989618 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:31.990314 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:31.990772 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:31.991202 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:32.119870 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:32.127562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a2c86dbb-2eb7-47d6-bf7a-965b31c610a8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.150769 Aug 23 16:46:32.128200 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 453/891] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:31 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:33.150689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:33.151292 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:33.157689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:33.158291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:33.158733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:33.159487 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:33.159954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:33.160348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:33.292113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:33.299725 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6f353ca6-f9e3-4ba7-86db-d46cfee8bee8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.152857 Aug 23 16:46:33.300303 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 439/892] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:33 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:34.320798 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:34.321910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:34.324317 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=6 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:34.331329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:34.331329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:34.331329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:34.331329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:34.331716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:34.331716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:34.462093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:34.469916 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c4785e86-1cbc-49c5-bb13-7ed4e4ec9851 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.152998 Aug 23 16:46:34.470487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 454/893] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:34 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:35.228602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-8ef0bfd5-5307-47b2-b4ef-ad7608ea0fab req-e83c0213-03f7-4921-b42e-1253bb49b15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35678a46-44f2-44f5-87d9-4af40d0b7d32", "name": "network-vif-plugged", "status": "completed", "tag": "c6fa608b-4c82-4b90-ae75-a59025725505"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:35.233833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:35.234509 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:35.240402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-8ef0bfd5-5307-47b2-b4ef-ad7608ea0fab req-e83c0213-03f7-4921-b42e-1253bb49b15b service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:35.241000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-8ef0bfd5-5307-47b2-b4ef-ad7608ea0fab req-e83c0213-03f7-4921-b42e-1253bb49b15b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:35.241345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-8ef0bfd5-5307-47b2-b4ef-ad7608ea0fab req-e83c0213-03f7-4921-b42e-1253bb49b15b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:35.252496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-8ef0bfd5-5307-47b2-b4ef-ad7608ea0fab req-e83c0213-03f7-4921-b42e-1253bb49b15b service nova] Creating event network-vif-plugged:c6fa608b-4c82-4b90-ae75-a59025725505 for instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 on hv-cinder-85032 Aug 23 16:46:35.257511 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-8ef0bfd5-5307-47b2-b4ef-ad7608ea0fab req-e83c0213-03f7-4921-b42e-1253bb49b15b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033344 Aug 23 16:46:35.258146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 440/894] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:46:35.491789 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:35.492427 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:35.498834 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:35.499318 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:35.499750 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:35.500472 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:35.500927 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:35.501354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:35.642342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:35.651320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3d898dc7-6452-4340-a543-c1cfed91bd33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.163351 Aug 23 16:46:35.652054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 455/895] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:35 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:36.684135 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:36.684866 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:36.691978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:36.692484 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:36.692935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:36.693593 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:36.694035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:36.694450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:36.827294 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:36.835068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-14b8989d-66a8-48f3-9195-af6ab06c1f86 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.156263 Aug 23 16:46:36.835717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 441/896] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:36 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:37.856918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:37.857522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:37.863956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:37.864466 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:37.864898 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:37.865637 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:37.866088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:37.866509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:37.996130 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:38.003886 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5622facd-b902-4ece-a1df-5eb1bdd98d70 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1367 microversion: 2.1 time: 0.151202 Aug 23 16:46:38.004590 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 456/897] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:37 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:39.024701 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:39.025314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:39.032427 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:39.032911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:39.033352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:39.034046 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:39.034498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:39.034920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:39.050171 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=100 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:39.164595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:39.173004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1b35d3fb-a2cd-4865-a5c8-0a44cac300ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1557 microversion: 2.1 time: 0.152111 Aug 23 16:46:39.173574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 442/898] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:39 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:39.192979 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c6ffb06f-d764-4f1c-81f3-ceab15563477 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:39.193512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c6ffb06f-d764-4f1c-81f3-ceab15563477 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:39.199825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6ffb06f-d764-4f1c-81f3-ceab15563477 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:39.200343 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6ffb06f-d764-4f1c-81f3-ceab15563477 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:39.200778 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6ffb06f-d764-4f1c-81f3-ceab15563477 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:39.201459 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6ffb06f-d764-4f1c-81f3-ceab15563477 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:39.201907 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6ffb06f-d764-4f1c-81f3-ceab15563477 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:39.202330 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c6ffb06f-d764-4f1c-81f3-ceab15563477 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:39.281881 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c6ffb06f-d764-4f1c-81f3-ceab15563477 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092714 Aug 23 16:46:39.282471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 457/899] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 23 16:46:39 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:40.504338 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-e10faecc-b909-4b70-a0ba-349aff3d74a0 req-bc1f6673-9d71-452e-8f39-63bc207073ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35678a46-44f2-44f5-87d9-4af40d0b7d32", "tag": "c6fa608b-4c82-4b90-ae75-a59025725505"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:40.514487 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-e10faecc-b909-4b70-a0ba-349aff3d74a0 req-bc1f6673-9d71-452e-8f39-63bc207073ed service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:40.515076 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-e10faecc-b909-4b70-a0ba-349aff3d74a0 req-bc1f6673-9d71-452e-8f39-63bc207073ed service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:40.515405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-e10faecc-b909-4b70-a0ba-349aff3d74a0 req-bc1f6673-9d71-452e-8f39-63bc207073ed service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:40.527420 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-e10faecc-b909-4b70-a0ba-349aff3d74a0 req-bc1f6673-9d71-452e-8f39-63bc207073ed service nova] Creating event network-changed:c6fa608b-4c82-4b90-ae75-a59025725505 for instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 on hv-cinder-85032 Aug 23 16:46:40.532592 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-e10faecc-b909-4b70-a0ba-349aff3d74a0 req-bc1f6673-9d71-452e-8f39-63bc207073ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031889 Aug 23 16:46:40.533598 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 443/900] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:53.908798 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=20 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:53.909545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:53.913569 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c3ff8f26-0884-4617-b6f7-c97a254dfa3b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:53.915718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c3ff8f26-0884-4617-b6f7-c97a254dfa3b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:53.922303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3ff8f26-0884-4617-b6f7-c97a254dfa3b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:53.929456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3ff8f26-0884-4617-b6f7-c97a254dfa3b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:53.929456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3ff8f26-0884-4617-b6f7-c97a254dfa3b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:53.929456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3ff8f26-0884-4617-b6f7-c97a254dfa3b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:53.929456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3ff8f26-0884-4617-b6f7-c97a254dfa3b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:53.929854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c3ff8f26-0884-4617-b6f7-c97a254dfa3b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:54.106432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c3ff8f26-0884-4617-b6f7-c97a254dfa3b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.199049 Aug 23 16:46:54.107294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 458/901] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:46:53 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f/os-volume_attachments => generated 25 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 16:46:54.168577 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:54.169151 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:54.172779 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=17 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:54.173560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=5 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:46:54.176935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:54.177413 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:54.177838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:54.178521 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:54.178963 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:54.179417 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:54.205300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:46:54.436047 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0997f15f-ca97-4121-9030-07a1ab92f940 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "DELETE /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 204 len: 0 microversion: 2.1 time: 0.271604 Aug 23 16:46:54.436627 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 444/902] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:46:54 2022] DELETE /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 16:46:54.445585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:54.446401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:54.453651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:54.454133 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:54.454574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:54.455262 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:54.455722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:54.456154 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:54.588956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:54.597329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-58d8aca6-dd32-47fe-be45-973179ad850c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1675 microversion: 2.1 time: 0.156244 Aug 23 16:46:54.597892 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 459/903] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:54 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:46:55.621382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:55.622109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:55.628746 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:55.629237 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:55.629672 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:55.630371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:55.630827 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:55.631314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:55.763146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:55.770989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b88922c5-bc66-4636-a357-cdee34500303 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1675 microversion: 2.1 time: 0.155845 Aug 23 16:46:55.771554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 445/904] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:55 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:56.793432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:56.794072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:56.800185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:56.800686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:56.801128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:56.801826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:56.802282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:56.802711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:56.869076 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:56.877160 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e60b30cc-6d7c-4227-b5b2-7e159ec30d98 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1607 microversion: 2.1 time: 0.088286 Aug 23 16:46:56.877826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 460/905] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:56 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1607 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:56.972193 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-4abdc370-9720-483a-b47e-79b4c463dbac req-75f97947-ebe0-4c29-9de4-ba023b48b9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abfc7760-8432-47e6-b2a3-b4052a52201f", "name": "network-vif-deleted", "tag": "e562daf2-33d4-4bb1-8e1b-b8386367dab6"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:56.978336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-4abdc370-9720-483a-b47e-79b4c463dbac req-75f97947-ebe0-4c29-9de4-ba023b48b9ce service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:56.978811 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-4abdc370-9720-483a-b47e-79b4c463dbac req-75f97947-ebe0-4c29-9de4-ba023b48b9ce service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:56.979235 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-4abdc370-9720-483a-b47e-79b4c463dbac req-75f97947-ebe0-4c29-9de4-ba023b48b9ce service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:56.991553 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-4abdc370-9720-483a-b47e-79b4c463dbac req-75f97947-ebe0-4c29-9de4-ba023b48b9ce service nova] Creating event network-vif-deleted:e562daf2-33d4-4bb1-8e1b-b8386367dab6 for instance abfc7760-8432-47e6-b2a3-b4052a52201f on hv-cinder-85032 Aug 23 16:46:56.997231 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-4abdc370-9720-483a-b47e-79b4c463dbac req-75f97947-ebe0-4c29-9de4-ba023b48b9ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032892 Aug 23 16:46:56.997838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 446/906] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:46:57.898485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:57.899246 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:57.905725 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:57.906252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:57.906693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:57.907570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:57.908029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:57.908492 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:57.941960 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:57.942583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:57.943027 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:57.943485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lazy-loading 'fault' on Instance uuid abfc7760-8432-47e6-b2a3-b4052a52201f {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:46:57.987817 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:46:57.997482 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5987e500-ef5e-41d5-bc07-e13d8f50f86d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 200 len: 1328 microversion: 2.1 time: 0.103140 Aug 23 16:46:57.998046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 461/907] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:57 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:46:59.019453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:59.020147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:46:59.027669 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:59.028178 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:59.028611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:59.029300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:46:59.029755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:46:59.030173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:46:59.043457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] HTTP exception thrown: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Request method failure captured: Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f HTTP/1.1 Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKZJT5_KBwniMpNChZlu6CGRNF2hhZLg2Ormg3kaO5WXcYmjJXrI7VUMclf9bLxvWD4lcCF-Nu4gL27OB6fiMYb5DrXnLw4vcLwJsCUJYkPQyLamDxGAiyAmSrt5SECCwe65w1uh5y0nLV_zobWVMFl_BJ6XZ4vmmSaj1dYBy7cNkI Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:46:59.045121 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97dc90210f5845e98a6bdb51aaef3518", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 5cbfcfbe01834b9ab9179bc032db813e Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:46:59.046563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': 'abfc7760-8432-47e6-b2a3-b4052a52201f'} Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:46:59.047361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:46:59.049136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:46:59.050470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Returning 404 to user: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:46:59.050470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a3b722a3-1106-4631-bb81-a4e44502f934 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 404 len: 111 microversion: 2.1 time: 0.031334 Aug 23 16:46:59.050470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 447/908] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:46:59 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:46:59.055544 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2f1f897e-8af9-4ed3-a280-e782b88ce56b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '.version_select at 0x7f677c983ee0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:46:59.128023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2f1f897e-8af9-4ed3-a280-e782b88ce56b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506735711" status: 202 len: 0 microversion: 2.1 time: 0.076158 Aug 23 16:46:59.128640 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 462/909] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 23 16:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506735711 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:46:59.871998 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1821d1bb-2eca-48e3-8a29-1fed8755de49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'create', calling method: .version_select at 0x7f677c8601f0>, body: {"keypair": {"name": "tempest-keypair-653487850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+BUaDnxrTFldLH/zfnEa+alyEgLRP0883drHuVA/XmCHM7yyiU0gUSqWs281wVg2+pIXaaxnwlEqs9wu4ibiTbRw1SP960SNokID+C7E9/LBH7Y6b8BFx2wDEU6KDFHg=="}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:46:59.887085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-1821d1bb-2eca-48e3-8a29-1fed8755de49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Getting quotas for project 97dc90210f5845e98a6bdb51aaef3518. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:46:59.890941 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-1821d1bb-2eca-48e3-8a29-1fed8755de49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Getting quotas for user 5cbfcfbe01834b9ab9179bc032db813e and project 97dc90210f5845e98a6bdb51aaef3518. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:46:59.973678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1821d1bb-2eca-48e3-8a29-1fed8755de49 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.105631 Aug 23 16:46:59.975937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 448/910] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:46:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:02.317054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-169027275", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6bf26c0b-4203-4d7e-869d-a3c87b647f65"}], "security_groups": [{"name": "tempest-securitygroup--414399888"}], "key_name": "tempest-keypair-653487850", "user_data": "}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:02.421095 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] validate_networks() for [('6bf26c0b-4203-4d7e-869d-a3c87b647f65', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:47:02.861795 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:47:02.862221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:47:02.862693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:47:02.863103 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:47:02.863515 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:47:02.872285 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:02.873259 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:02.873698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:02.874422 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:02.874935 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:02.875366 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:02.892722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Getting quotas for project 97dc90210f5845e98a6bdb51aaef3518. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:47:02.896761 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Getting quotas for user 5cbfcfbe01834b9ab9179bc032db813e and project 97dc90210f5845e98a6bdb51aaef3518. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:47:02.907585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:47:02.909869 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:47:03.059769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e16eae20-b3f4-428c-9dd6-a74d78adfc59 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.747074 Aug 23 16:47:03.061121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 463/911] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:47:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:47:03.072943 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d6221ce8-ab54-4c1b-89d0-0fcc760d9dbb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:03.073554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d6221ce8-ab54-4c1b-89d0-0fcc760d9dbb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:03.132925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d6221ce8-ab54-4c1b-89d0-0fcc760d9dbb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:03.146403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d6221ce8-ab54-4c1b-89d0-0fcc760d9dbb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1236 microversion: 2.1 time: 0.078220 Aug 23 16:47:03.147188 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 449/912] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:03 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:04.167161 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:04.167787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:04.174692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:04.180120 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:04.180120 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:04.180120 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:04.180120 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:04.180530 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:04.238875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:04.246913 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-742e0227-047a-4e13-9b0c-1000de6803ba tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1240 microversion: 2.1 time: 0.083803 Aug 23 16:47:04.251018 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 464/913] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:04 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:05.270279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:05.270908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:05.276927 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:05.277415 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:05.277858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:05.279053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:05.279516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:05.279942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:05.343954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:05.352013 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a141e175-e28f-4f70-90e7-a09f80923d5b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1296 microversion: 2.1 time: 0.086159 Aug 23 16:47:05.352802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 450/914] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:05 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:06.375088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:06.375714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:06.382660 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:06.383145 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:06.383638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:06.384441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:06.384919 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:06.385515 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:06.523051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:06.542893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0a795884-b25a-484c-829b-bfcbc1ec778c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1361 microversion: 2.1 time: 0.162654 Aug 23 16:47:06.542893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 465/915] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:06 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:07.183791 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-595e7cad-0f15-45d6-a258-7df2563cdebe req-a89f1454-2809-4e41-b0a3-6aae061282bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc849ee7-f7a6-479e-823a-928a7a5c22aa", "tag": "8d99ff1c-cc20-428a-8094-0934e067d97c"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:07.194140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-595e7cad-0f15-45d6-a258-7df2563cdebe req-a89f1454-2809-4e41-b0a3-6aae061282bb service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:07.194623 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-595e7cad-0f15-45d6-a258-7df2563cdebe req-a89f1454-2809-4e41-b0a3-6aae061282bb service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:07.195051 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-595e7cad-0f15-45d6-a258-7df2563cdebe req-a89f1454-2809-4e41-b0a3-6aae061282bb service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:07.206656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-595e7cad-0f15-45d6-a258-7df2563cdebe req-a89f1454-2809-4e41-b0a3-6aae061282bb service nova] Creating event network-changed:8d99ff1c-cc20-428a-8094-0934e067d97c for instance bc849ee7-f7a6-479e-823a-928a7a5c22aa on hv-cinder-85032 Aug 23 16:47:07.211609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-595e7cad-0f15-45d6-a258-7df2563cdebe req-a89f1454-2809-4e41-b0a3-6aae061282bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031584 Aug 23 16:47:07.212230 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 451/916] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:07.557190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:07.557796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:07.564870 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:07.565358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:07.565799 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:07.566496 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:07.566953 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:07.567385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:07.704179 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:07.712172 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d34e278f-47e5-4132-8977-fc04f018a1ec tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1361 microversion: 2.1 time: 0.158866 Aug 23 16:47:07.712748 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 466/917] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:07 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:08.734638 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:08.735327 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:08.741418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:08.741895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:08.742326 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:08.743004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:08.743449 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:08.743864 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:08.870432 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:08.878614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e5c2ab5e-9797-4ae5-95d5-883e31d66f3d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1361 microversion: 2.1 time: 0.148883 Aug 23 16:47:08.880097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 452/918] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:08 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:09.899188 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:09.899770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:09.906829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:09.907310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:09.907742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:09.908461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:09.908913 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:09.909338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:10.040244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:10.047886 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3d164eff-cd4b-4a95-b93e-c86d1c85d10c tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1361 microversion: 2.1 time: 0.152488 Aug 23 16:47:10.048461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 467/919] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:09 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:11.068366 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:11.068982 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:11.075672 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:11.076151 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:11.076619 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:11.077311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:11.077773 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:11.078198 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:11.209531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:11.218223 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-335d9979-e53a-4a37-9f5c-d7ac37b848eb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1361 microversion: 2.1 time: 0.153699 Aug 23 16:47:11.218796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 453/920] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:11 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:12.239681 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:12.240247 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:12.246562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:12.247043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:12.247473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:12.248152 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:12.248652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:12.249086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:12.381808 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:12.389348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a245bc93-d100-481d-9e50-816a19a878f4 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1361 microversion: 2.1 time: 0.154116 Aug 23 16:47:12.389913 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 468/921] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:12 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:13.366297 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-fd3ed10b-8eac-4a4d-a9dc-cf264e46b0d9 req-77357ff9-a6fe-42af-a4ff-d6f2058579ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc849ee7-f7a6-479e-823a-928a7a5c22aa", "name": "network-vif-plugged", "status": "completed", "tag": "8d99ff1c-cc20-428a-8094-0934e067d97c"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:13.371670 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:13.377024 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-fd3ed10b-8eac-4a4d-a9dc-cf264e46b0d9 req-77357ff9-a6fe-42af-a4ff-d6f2058579ff service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:13.377497 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-fd3ed10b-8eac-4a4d-a9dc-cf264e46b0d9 req-77357ff9-a6fe-42af-a4ff-d6f2058579ff service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:13.377923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-fd3ed10b-8eac-4a4d-a9dc-cf264e46b0d9 req-77357ff9-a6fe-42af-a4ff-d6f2058579ff service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:13.388588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-fd3ed10b-8eac-4a4d-a9dc-cf264e46b0d9 req-77357ff9-a6fe-42af-a4ff-d6f2058579ff service nova] Creating event network-vif-plugged:8d99ff1c-cc20-428a-8094-0934e067d97c for instance bc849ee7-f7a6-479e-823a-928a7a5c22aa on hv-cinder-85032 Aug 23 16:47:13.393614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-fd3ed10b-8eac-4a4d-a9dc-cf264e46b0d9 req-77357ff9-a6fe-42af-a4ff-d6f2058579ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031044 Aug 23 16:47:13.394194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 454/922] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:13.410208 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:13.410850 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:13.412689 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:13.413348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=6 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:13.418525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:13.419009 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:13.419442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:13.420124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:13.420597 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:13.421021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:13.557459 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:13.565994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-620f42ad-04f7-410b-8673-ac82a9ca00d7 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1361 microversion: 2.1 time: 0.160102 Aug 23 16:47:13.566563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 469/923] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:13 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:14.587999 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:14.588750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:14.595365 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:14.596524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:14.596953 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:14.597641 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:14.598085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:14.598503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:14.731311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:14.739451 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f8b1faf2-a9a5-429c-b628-b90bdb18844b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1361 microversion: 2.1 time: 0.156061 Aug 23 16:47:14.740020 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 455/924] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:14 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:15.761511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:15.762101 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:15.768942 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:15.769428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:15.769861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:15.770555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:15.771004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:15.771425 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:15.915993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:15.924468 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d20e24c9-abc4-4018-b650-c33db6e7f6d2 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1547 microversion: 2.1 time: 0.166735 Aug 23 16:47:15.924999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 470/925] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:15 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:15.944728 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f05e78cb-7f4f-4611-94c4-875e9c6487b1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:15.945461 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f05e78cb-7f4f-4611-94c4-875e9c6487b1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:15.952189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f05e78cb-7f4f-4611-94c4-875e9c6487b1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:15.952704 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f05e78cb-7f4f-4611-94c4-875e9c6487b1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:15.953098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f05e78cb-7f4f-4611-94c4-875e9c6487b1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:15.954028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f05e78cb-7f4f-4611-94c4-875e9c6487b1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:15.954478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f05e78cb-7f4f-4611-94c4-875e9c6487b1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:15.955393 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f05e78cb-7f4f-4611-94c4-875e9c6487b1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:16.037862 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f05e78cb-7f4f-4611-94c4-875e9c6487b1 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097030 Aug 23 16:47:16.038457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 456/926] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 23 16:47:15 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:17.083088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-76ca0cee-5180-4071-9bb7-067eb77f219c req-60728dda-eb1b-488f-aadc-88b7fd6d5799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc849ee7-f7a6-479e-823a-928a7a5c22aa", "tag": "8d99ff1c-cc20-428a-8094-0934e067d97c"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:17.093046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-76ca0cee-5180-4071-9bb7-067eb77f219c req-60728dda-eb1b-488f-aadc-88b7fd6d5799 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:17.093529 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-76ca0cee-5180-4071-9bb7-067eb77f219c req-60728dda-eb1b-488f-aadc-88b7fd6d5799 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:17.093971 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-76ca0cee-5180-4071-9bb7-067eb77f219c req-60728dda-eb1b-488f-aadc-88b7fd6d5799 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:17.105640 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-76ca0cee-5180-4071-9bb7-067eb77f219c req-60728dda-eb1b-488f-aadc-88b7fd6d5799 service nova] Creating event network-changed:8d99ff1c-cc20-428a-8094-0934e067d97c for instance bc849ee7-f7a6-479e-823a-928a7a5c22aa on hv-cinder-85032 Aug 23 16:47:17.111567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-76ca0cee-5180-4071-9bb7-067eb77f219c req-60728dda-eb1b-488f-aadc-88b7fd6d5799 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031548 Aug 23 16:47:17.112406 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 471/927] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:20.236453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:20.237574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:20.243509 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:20.244008 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:20.244444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:20.245133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:20.245579 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:20.246022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:20.327043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lazy-loading 'services' on Instance uuid 0de441a4-ffc5-43ff-bf83-faec28f6ed1f {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:47:20.583758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7c2e0bf5-a4eb-45aa-a62e-956852aa924b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments/5b9a386a-077b-4100-90f3-4fd03534ad7b" status: 202 len: 0 microversion: 2.1 time: 0.351829 Aug 23 16:47:20.584457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 457/928] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:47:20 2022] DELETE /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments/5b9a386a-077b-4100-90f3-4fd03534ad7b => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:47:20.595379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-43315a10-db81-43e1-a19f-582a633e9c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:20.599449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-43315a10-db81-43e1-a19f-582a633e9c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:20.605662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-43315a10-db81-43e1-a19f-582a633e9c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:20.606145 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-43315a10-db81-43e1-a19f-582a633e9c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:20.606583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-43315a10-db81-43e1-a19f-582a633e9c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:20.607534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-43315a10-db81-43e1-a19f-582a633e9c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:20.607981 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-43315a10-db81-43e1-a19f-582a633e9c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:20.608428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-43315a10-db81-43e1-a19f-582a633e9c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:20.639692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-43315a10-db81-43e1-a19f-582a633e9c20 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050451 Aug 23 16:47:20.640274 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 472/929] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:47:20 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:21.654054 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9364ca0f-2566-47e9-af68-cbbfb63d288c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:21.656455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9364ca0f-2566-47e9-af68-cbbfb63d288c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:21.663219 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9364ca0f-2566-47e9-af68-cbbfb63d288c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:21.663708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9364ca0f-2566-47e9-af68-cbbfb63d288c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:21.664148 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9364ca0f-2566-47e9-af68-cbbfb63d288c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:21.664884 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9364ca0f-2566-47e9-af68-cbbfb63d288c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:21.665339 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9364ca0f-2566-47e9-af68-cbbfb63d288c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:21.665765 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9364ca0f-2566-47e9-af68-cbbfb63d288c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:21.696708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9364ca0f-2566-47e9-af68-cbbfb63d288c tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047357 Aug 23 16:47:21.697279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 458/930] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:47:21 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:22.708371 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9e77091f-d002-4055-85f6-da70b5d2d309 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:22.710509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9e77091f-d002-4055-85f6-da70b5d2d309 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:22.717046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e77091f-d002-4055-85f6-da70b5d2d309 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:22.717536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e77091f-d002-4055-85f6-da70b5d2d309 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:22.717976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e77091f-d002-4055-85f6-da70b5d2d309 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:22.718674 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e77091f-d002-4055-85f6-da70b5d2d309 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:22.719213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e77091f-d002-4055-85f6-da70b5d2d309 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:22.719562 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e77091f-d002-4055-85f6-da70b5d2d309 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:22.748110 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9e77091f-d002-4055-85f6-da70b5d2d309 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043694 Aug 23 16:47:22.748693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 473/931] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:47:22 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 16:47:22.831876 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:22.832453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:22.838994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:22.839469 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:22.839897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:22.840628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:22.841081 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:22.841494 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:22.866636 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:47:23.166615 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4db91a9a-fe2c-4a9d-b1cd-3adf962046d0 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 204 len: 0 microversion: 2.1 time: 0.338285 Aug 23 16:47:23.167204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 459/932] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:47:22 2022] DELETE /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:47:23.175769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:23.176508 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:23.182522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:23.183014 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:23.183462 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:23.184196 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:23.184676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:23.185095 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:23.316819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:23.324693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-64b2fdff-820c-449f-aa06-706dee702f05 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1690 microversion: 2.1 time: 0.153300 Aug 23 16:47:23.325190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 474/933] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:23 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:24.346513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:24.347202 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:24.349668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:24.354667 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:24.355140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:24.355567 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:24.361370 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:24.361370 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:24.361370 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:24.361370 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:24.489578 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:24.496731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-efdd33ae-d896-4963-8542-5371cd3c58d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:24.497279 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-efdd33ae-d896-4963-8542-5371cd3c58d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:24.498651 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0a1c7a47-990b-4fdf-a44b-5651e92ae8ed tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1690 microversion: 2.1 time: 0.156468 Aug 23 16:47:24.499227 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 460/934] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:24 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:24.503000 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:24.507879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-efdd33ae-d896-4963-8542-5371cd3c58d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:24.508413 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-efdd33ae-d896-4963-8542-5371cd3c58d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:24.509265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-efdd33ae-d896-4963-8542-5371cd3c58d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:24.509701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-efdd33ae-d896-4963-8542-5371cd3c58d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:24.510165 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-efdd33ae-d896-4963-8542-5371cd3c58d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:24.510732 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-efdd33ae-d896-4963-8542-5371cd3c58d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:24.513385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=91 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:24.540836 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-efdd33ae-d896-4963-8542-5371cd3c58d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments/8d663b0f-f2dc-4784-981c-0eb16d2067e5" status: 200 len: 194 microversion: 2.20 time: 0.047817 Aug 23 16:47:24.541388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 475/935] 10.222.0.52 () {60 vars in 1454 bytes} [Tue Aug 23 16:47:24 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments/8d663b0f-f2dc-4784-981c-0eb16d2067e5 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 16:47:24.609586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:24.610076 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:24.616923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:24.617333 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:24.617765 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:24.618456 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:24.618912 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:24.619337 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:24.702809 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lazy-loading 'services' on Instance uuid 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:47:24.982244 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b0e62fb4-858b-4144-988a-c29329d97786 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments/8d663b0f-f2dc-4784-981c-0eb16d2067e5" status: 202 len: 0 microversion: 2.20 time: 0.376713 Aug 23 16:47:24.982762 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 461/936] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Aug 23 16:47:24 2022] DELETE /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments/8d663b0f-f2dc-4784-981c-0eb16d2067e5 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:47:24.991573 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3522c327-caef-42f8-ba7a-91ddd218ef4d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:24.993752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3522c327-caef-42f8-ba7a-91ddd218ef4d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:25.000878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3522c327-caef-42f8-ba7a-91ddd218ef4d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:25.001369 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3522c327-caef-42f8-ba7a-91ddd218ef4d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:25.001808 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3522c327-caef-42f8-ba7a-91ddd218ef4d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:25.002553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3522c327-caef-42f8-ba7a-91ddd218ef4d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:25.003051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3522c327-caef-42f8-ba7a-91ddd218ef4d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:25.003486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3522c327-caef-42f8-ba7a-91ddd218ef4d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:25.033320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3522c327-caef-42f8-ba7a-91ddd218ef4d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045853 Aug 23 16:47:25.033881 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 476/937] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 23 16:47:24 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:47:25.522906 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:25.523614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:25.530609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:25.531097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:25.531530 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:25.532264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:25.532718 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:25.533146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:25.677429 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:25.685989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-aa16ae2b-ff57-4127-a74b-01be74b20f90 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1690 microversion: 2.1 time: 0.167379 Aug 23 16:47:25.686589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 462/938] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:25 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:47:26.046730 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-054ba15e-1556-4f54-b582-fad4e17fb83c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:26.049009 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-054ba15e-1556-4f54-b582-fad4e17fb83c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:26.056473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-054ba15e-1556-4f54-b582-fad4e17fb83c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:26.056961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-054ba15e-1556-4f54-b582-fad4e17fb83c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:26.057406 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-054ba15e-1556-4f54-b582-fad4e17fb83c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:26.058106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-054ba15e-1556-4f54-b582-fad4e17fb83c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:26.058567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-054ba15e-1556-4f54-b582-fad4e17fb83c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:26.059000 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-054ba15e-1556-4f54-b582-fad4e17fb83c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:26.088399 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-054ba15e-1556-4f54-b582-fad4e17fb83c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045589 Aug 23 16:47:26.089307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 477/939] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 23 16:47:26 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:47:26.707033 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:26.707666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:26.714959 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:26.715449 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:26.715886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:26.716663 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:26.717120 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:26.717544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:26.865758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:26.873714 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2cc3ac82-2d6d-45ec-8360-7c9ea694bae9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1690 microversion: 2.1 time: 0.170607 Aug 23 16:47:26.874278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 463/940] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:26 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:27.101726 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-694eefbf-6a6e-4c30-ba0b-74b514cd2ba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:27.104229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-694eefbf-6a6e-4c30-ba0b-74b514cd2ba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:27.111450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-694eefbf-6a6e-4c30-ba0b-74b514cd2ba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.112257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-694eefbf-6a6e-4c30-ba0b-74b514cd2ba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.112904 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-694eefbf-6a6e-4c30-ba0b-74b514cd2ba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.113636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-694eefbf-6a6e-4c30-ba0b-74b514cd2ba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.114331 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-694eefbf-6a6e-4c30-ba0b-74b514cd2ba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.115555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-694eefbf-6a6e-4c30-ba0b-74b514cd2ba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.147058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-694eefbf-6a6e-4c30-ba0b-74b514cd2ba4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049571 Aug 23 16:47:27.147619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 478/941] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 23 16:47:27 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:27.216317 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:27.216739 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:27.222989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.223700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.224137 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.224859 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.225314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.225742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.255742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:47:27.292808 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-6ad9e094-9045-45c4-9262-48c2678cff2e req-fd997cd0-0c6e-4210-97f7-f4ddf733c752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de441a4-ffc5-43ff-bf83-faec28f6ed1f", "name": "network-vif-deleted", "tag": "a6f566e4-5cdd-45cb-b319-5370499e6059"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:27.303120 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-6ad9e094-9045-45c4-9262-48c2678cff2e req-fd997cd0-0c6e-4210-97f7-f4ddf733c752 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.303712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-6ad9e094-9045-45c4-9262-48c2678cff2e req-fd997cd0-0c6e-4210-97f7-f4ddf733c752 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.304149 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-6ad9e094-9045-45c4-9262-48c2678cff2e req-fd997cd0-0c6e-4210-97f7-f4ddf733c752 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.315772 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-6ad9e094-9045-45c4-9262-48c2678cff2e req-fd997cd0-0c6e-4210-97f7-f4ddf733c752 service nova] Creating event network-vif-deleted:a6f566e4-5cdd-45cb-b319-5370499e6059 for instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f on hv-cinder-85032 Aug 23 16:47:27.321583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-6ad9e094-9045-45c4-9262-48c2678cff2e req-fd997cd0-0c6e-4210-97f7-f4ddf733c752 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032456 Aug 23 16:47:27.322440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 479/942] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:47:27.602753 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cd4a3716-4ee3-4827-817b-e3b57f0b2a5c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 204 len: 0 microversion: 2.20 time: 0.390231 Aug 23 16:47:27.603495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 464/943] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 23 16:47:27 2022] DELETE /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 16:47:27.613044 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:27.614014 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:27.621410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.622382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.623068 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.624013 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.624712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.625361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.767416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:27.776486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:27.777996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:27.779175 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7ecdee7c-7fb5-40b6-9ee4-4e5eebf05f02 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.170726 Aug 23 16:47:27.779729 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 480/944] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:27 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:27.896772 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:27.897476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:27.904276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.904776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.905210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.905909 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.906365 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.906782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.941545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:27.942031 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:27.942465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:27.942966 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lazy-loading 'fault' on Instance uuid 0de441a4-ffc5-43ff-bf83-faec28f6ed1f {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:47:27.992640 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:28.000975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-efc725c4-36e8-4bf3-91f9-15e6d3ac26d6 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1335 microversion: 2.1 time: 0.109158 Aug 23 16:47:28.001572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 465/945] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:27 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:28.803635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:28.804340 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:28.811031 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:28.811526 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:28.811972 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:28.812721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:28.813183 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:28.813614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:28.953862 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:28.962806 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:28.964345 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:28.965535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1ebba317-633c-41e4-8fa2-bdbff13fb0de tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.166464 Aug 23 16:47:28.966097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 481/946] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:28 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:29.022751 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:29.023362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:29.030488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:29.030969 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:29.031411 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:29.032114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:29.032594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:29.033018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:29.069630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:29.070030 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:29.070478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:29.070921 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lazy-loading 'fault' on Instance uuid 0de441a4-ffc5-43ff-bf83-faec28f6ed1f {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:47:29.116353 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:29.124337 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6f628b08-aed6-49f1-bdc7-8f4677b06f1b tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 200 len: 1335 microversion: 2.1 time: 0.105783 Aug 23 16:47:29.124924 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 466/947] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:29 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:29.990122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:29.990677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:29.997976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:29.998530 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:29.998969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:29.999683 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:30.000194 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:30.000630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:30.143599 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:30.145076 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:30.145696 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: 0de441a4-ffc5-43ff-bf83-faec28f6ed1f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:30.152093 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:30.152600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:30.152822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:30.153029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:30.153931 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:30.154334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:30.154452 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:30.154794 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:30.155528 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-739c11cd-4174-4a24-a723-c97c32ff053e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1723 microversion: 2.20 time: 0.169841 Aug 23 16:47:30.156316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 482/948] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:29 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:30.170740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] HTTP exception thrown: Instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f could not be found. Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Request method failure captured: Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f HTTP/1.1 Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKYblaySY69o3r67kZXBryao_JDz8ISrivQ4koxsrmPtheZvDHuaJfkPKyTtGzAPMTZ0C_nBLI8kFRTmhFlEKYQNhz9rpsAUQn2twU4r9ydG41I-t1EJaMk29PXKgrUhqFvE6UV4XUsrtUpM3-SncpZB3kDhTQxJcVSY8_WbTBR_cM Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:47:30.172498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_102f835e0f424477aab1d540a2a15d22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 50c9a90fabc0466988ed6bae32beb47f Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f could not be found. Aug 23 16:47:30.174310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '0de441a4-ffc5-43ff-bf83-faec28f6ed1f'} Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f could not be found. Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:47:30.175742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f could not be found. Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f could not be found. Aug 23 16:47:30.177720 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:30.179611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Returning 404 to user: Instance 0de441a4-ffc5-43ff-bf83-faec28f6ed1f could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:47:30.179611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f36ec2aa-9a7b-474b-a783-b35bb84d7bbd tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f" status: 404 len: 111 microversion: 2.1 time: 0.032871 Aug 23 16:47:30.179611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 467/949] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:30 2022] GET /compute/v2.1/servers/0de441a4-ffc5-43ff-bf83-faec28f6ed1f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 16:47:30.185407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c14bb60f-7ca2-4a0a-8aeb-779f42e0f006 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '.version_select at 0x7f677ca12040>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:30.260186 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c14bb60f-7ca2-4a0a-8aeb-779f42e0f006 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-294827385" status: 202 len: 0 microversion: 2.1 time: 0.078323 Aug 23 16:47:30.260637 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 483/950] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Aug 23 16:47:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-294827385 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:47:31.092779 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-c22341f4-f190-49e3-aa14-9a46314eae3f req-075468bf-7516-4aac-a3f3-68e2b98bfbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8", "name": "network-vif-deleted", "tag": "e24378e6-7626-4b59-81eb-752fbcca503a"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:31.118428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-c22341f4-f190-49e3-aa14-9a46314eae3f req-075468bf-7516-4aac-a3f3-68e2b98bfbd8 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:31.119180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-c22341f4-f190-49e3-aa14-9a46314eae3f req-075468bf-7516-4aac-a3f3-68e2b98bfbd8 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:31.119888 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-c22341f4-f190-49e3-aa14-9a46314eae3f req-075468bf-7516-4aac-a3f3-68e2b98bfbd8 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:31.144279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-c22341f4-f190-49e3-aa14-9a46314eae3f req-075468bf-7516-4aac-a3f3-68e2b98bfbd8 service nova] Creating event network-vif-deleted:e24378e6-7626-4b59-81eb-752fbcca503a for instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 on hv-cinder-85032 Aug 23 16:47:31.149092 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-c22341f4-f190-49e3-aa14-9a46314eae3f req-075468bf-7516-4aac-a3f3-68e2b98bfbd8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059869 Aug 23 16:47:31.149953 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 468/951] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:31.183563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:31.185778 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:31.194244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:31.195256 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:31.195705 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:31.196467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:31.197001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:31.197435 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:31.338483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:31.353854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:31.355608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:31.357341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-363990c6-6fd0-4ef1-9334-b5c2f1d5425c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 200 len: 1656 microversion: 2.20 time: 0.181568 Aug 23 16:47:31.366912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 484/952] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:31 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 1656 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:47:32.382343 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:32.383041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:32.389518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:32.389996 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:32.390431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:32.391140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:32.391589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:32.392049 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:32.406270 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] HTTP exception thrown: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Request method failure captured: Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 HTTP/1.1 Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQMKtg-IuAzdOB2pLnbFp-5eAFrYAKiI_0sh0gH4o8WMpHEHi6kRpUDfJDoD9Xe8hUVnwRZATw4PoRaGr5DixCNw0qwy6kcBl7Wn1NuuKQiOJgtvpJNHoMmrbwCM8-n5uYKP8ezvD8LK6MDBy5JjV3efBltJn1pV5bbEkyW97F6osHU Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:47:32.407890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7bdf236fc9724490a26aeac2b680918b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 1ff570c1fa134bcebfd597ded5a95168 Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:47:32.410752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8'} Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:47:32.411655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:47:32.413255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:47:32.415103 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Returning 404 to user: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:47:32.415103 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e51fd936-fbbf-4731-ba93-4654404df994 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 404 len: 111 microversion: 2.20 time: 0.031913 Aug 23 16:47:32.415103 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 469/953] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:32 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:47:32.419211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-51fc3241-215b-45f7-9edc-edd7a1990963 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '.version_select at 0x7f677c8ea0d0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:32.531959 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-51fc3241-215b-45f7-9edc-edd7a1990963 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929487978" status: 204 len: 0 microversion: 2.20 time: 0.116565 Aug 23 16:47:32.532635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 485/954] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Aug 23 16:47:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929487978 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 16:47:33.414790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cb301df8-566c-4b4a-99e6-04517f1f08b1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'create', calling method: .version_select at 0x7f677c8a8af0>, body: {"keypair": {"name": "tempest-keypair-1734466419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzxM292X7V7hIY0/IENFOo6dC6oVV+WKHB/m5/aKhfIcMcV/XjcigtevAS7B0BEDlWCHbNtwAVNVPQASzQEhuIB9WNbGhoYCyWdOifmJhM+HKAQjmabBwwtNeL7NRfwEw=="}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:33.431429 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-cb301df8-566c-4b4a-99e6-04517f1f08b1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Getting quotas for project 7bdf236fc9724490a26aeac2b680918b. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:47:33.435297 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-cb301df8-566c-4b4a-99e6-04517f1f08b1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Getting quotas for user 1ff570c1fa134bcebfd597ded5a95168 and project 7bdf236fc9724490a26aeac2b680918b. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:47:33.522681 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cb301df8-566c-4b4a-99e6-04517f1f08b1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.112372 Aug 23 16:47:33.523287 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 470/955] 10.222.0.52 () {62 vars in 1200 bytes} [Tue Aug 23 16:47:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 16:47:33.974254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:33.974728 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:33.982532 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:33.983016 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:33.983457 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:33.984236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:33.984727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:33.985307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:34.011000 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Going to try to terminate instance {{(pid=133198) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:47:34.332096 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-53dc5a70-d5b5-4253-b603-304b816b8321 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 204 len: 0 microversion: 2.1 time: 0.362593 Aug 23 16:47:34.332727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 486/956] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:47:33 2022] DELETE /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:47:34.341498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:34.342043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:34.348853 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:34.349331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:34.349757 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:34.350436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:34.350890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:34.351298 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:34.487106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:34.495396 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7d4ef136-ff9b-4d65-9caa-194142d8f5d2 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1508 microversion: 2.1 time: 0.157869 Aug 23 16:47:34.495970 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 471/957] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:34 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:35.519321 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:35.521307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:35.528899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:35.529606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:35.530319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:35.531364 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:35.532033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:35.532579 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:35.704931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:35.730048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9f32704b-c552-453e-9adc-4606332581a5 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1508 microversion: 2.1 time: 0.199420 Aug 23 16:47:35.730048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 487/958] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:35 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:35.907920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-96f1a4c1-cb85-47e6-b24a-f21dcc1833aa req-3b6144bf-16d6-4b55-9631-2d6f097841fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf88c183-6ffb-49b3-88b4-1813e0e5aeec", "name": "network-vif-deleted", "tag": "45eb8b58-4ba5-4b31-9a39-10f2210f3a27"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:35.925906 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-96f1a4c1-cb85-47e6-b24a-f21dcc1833aa req-3b6144bf-16d6-4b55-9631-2d6f097841fe service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:35.926782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-96f1a4c1-cb85-47e6-b24a-f21dcc1833aa req-3b6144bf-16d6-4b55-9631-2d6f097841fe service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:35.927567 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-96f1a4c1-cb85-47e6-b24a-f21dcc1833aa req-3b6144bf-16d6-4b55-9631-2d6f097841fe service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:35.950506 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-96f1a4c1-cb85-47e6-b24a-f21dcc1833aa req-3b6144bf-16d6-4b55-9631-2d6f097841fe service nova] Creating event network-vif-deleted:45eb8b58-4ba5-4b31-9a39-10f2210f3a27 for instance bf88c183-6ffb-49b3-88b4-1813e0e5aeec on hv-cinder-85032 Aug 23 16:47:35.957109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-96f1a4c1-cb85-47e6-b24a-f21dcc1833aa req-3b6144bf-16d6-4b55-9631-2d6f097841fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056021 Aug 23 16:47:35.957923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 472/959] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:47:36.464733 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1918059423", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d28766e3-e0fc-4cc9-b12d-6b16a6e8b439"}], "security_groups": [{"name": "tempest-securitygroup--553413399"}], "key_name": "tempest-keypair-1734466419", "user_data": "}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:36.580087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] validate_networks() for [('d28766e3-e0fc-4cc9-b12d-6b16a6e8b439', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:47:36.736907 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:36.737604 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:36.745086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:36.745474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:36.745790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:36.746497 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:36.747474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:36.747474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:36.784468 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:36.785361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:36.786148 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:36.786964 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lazy-loading 'fault' on Instance uuid bf88c183-6ffb-49b3-88b4-1813e0e5aeec {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:47:36.849151 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:36.859664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-879b6029-10f1-4b76-b72f-e08e4fcc0e57 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 200 len: 1311 microversion: 2.1 time: 0.128497 Aug 23 16:47:36.872453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 473/960] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:36 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:47:37.022798 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:47:37.023554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:47:37.024950 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:47:37.025657 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:47:37.026376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:47:37.041470 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:37.042282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:37.043068 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:37.044447 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:37.045290 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:37.046046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:37.077058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Getting quotas for project 7bdf236fc9724490a26aeac2b680918b. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:47:37.083386 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Getting quotas for user 1ff570c1fa134bcebfd597ded5a95168 and project 7bdf236fc9724490a26aeac2b680918b. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:47:37.097100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:47:37.099318 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:47:37.236035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e4b21f8a-116f-4bfe-b0e4-ae0459adfc3c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.775620 Aug 23 16:47:37.236804 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 488/961] 10.222.0.52 () {62 vars in 1188 bytes} [Tue Aug 23 16:47:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 16:47:37.247939 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-76bd2a0c-8703-4d93-b881-20d472bada85 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:37.248586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-76bd2a0c-8703-4d93-b881-20d472bada85 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:37.306249 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-76bd2a0c-8703-4d93-b881-20d472bada85 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:37.314022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-76bd2a0c-8703-4d93-b881-20d472bada85 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:37.316010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-76bd2a0c-8703-4d93-b881-20d472bada85 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:37.323649 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-76bd2a0c-8703-4d93-b881-20d472bada85 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1282 microversion: 2.20 time: 0.073434 Aug 23 16:47:37.323649 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 474/962] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:37 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:37.881383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:37.882025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: bf88c183-6ffb-49b3-88b4-1813e0e5aeec] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:37.889201 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:37.889948 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:37.890185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:37.890905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:37.891371 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:37.891808 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:37.906520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] HTTP exception thrown: Instance bf88c183-6ffb-49b3-88b4-1813e0e5aeec could not be found. Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Request method failure captured: Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec HTTP/1.1 Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKYblaySY69o3r67kZXBryao_JDz8ISrivQ4koxsrmPtheZvDHuaJfkPKyTtGzAPMTZ0C_nBLI8kFRTmhFlEKYQNhz9rpsAUQn2twU4r9ydG41I-t1EJaMk29PXKgrUhqFvE6UV4XUsrtUpM3-SncpZB3kDhTQxJcVSY8_WbTBR_cM Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:47:37.908253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_102f835e0f424477aab1d540a2a15d22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 50c9a90fabc0466988ed6bae32beb47f Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance bf88c183-6ffb-49b3-88b4-1813e0e5aeec could not be found. Aug 23 16:47:37.909831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'bf88c183-6ffb-49b3-88b4-1813e0e5aeec'} Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf88c183-6ffb-49b3-88b4-1813e0e5aeec could not be found. Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:47:37.910813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf88c183-6ffb-49b3-88b4-1813e0e5aeec could not be found. Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf88c183-6ffb-49b3-88b4-1813e0e5aeec could not be found. Aug 23 16:47:37.912137 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:37.913600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Returning 404 to user: Instance bf88c183-6ffb-49b3-88b4-1813e0e5aeec could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:47:37.913600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f1fffac7-0fe8-4e7e-a0f3-744750a0db91 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec" status: 404 len: 111 microversion: 2.1 time: 0.032845 Aug 23 16:47:37.913600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 489/963] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:37 2022] GET /compute/v2.1/servers/bf88c183-6ffb-49b3-88b4-1813e0e5aeec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:47:37.919883 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:37.920428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:37.926951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:37.927446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:37.927923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:37.928669 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:37.929128 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:37.929716 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:37.956957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:47:38.303732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9887f4dc-57b6-49a7-a6ae-1a9262d953e9 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 204 len: 0 microversion: 2.1 time: 0.387629 Aug 23 16:47:38.304438 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 475/964] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:47:37 2022] DELETE /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:47:38.312592 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:38.313205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:38.319507 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:38.319995 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:38.320456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:38.321160 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:38.321689 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:38.322096 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:38.342316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:38.345183 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:38.349346 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:38.349839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:38.350271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:38.351106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:38.351568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:38.352123 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:38.371670 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:38.432001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:38.441240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:38.442805 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:38.443900 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cd498c57-0bee-4701-8bb4-a3d390a0fdb7 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1286 microversion: 2.20 time: 0.106424 Aug 23 16:47:38.444518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 476/965] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:38 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:38.506623 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:38.515526 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-99a8726b-586f-46da-b90f-4af1aed92655 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.206722 Aug 23 16:47:38.516117 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 490/966] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:38 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:39.465889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:39.466532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:39.473846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:39.474331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:39.474767 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:39.475469 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:39.475925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:39.476373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:39.537578 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:39.538267 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:39.542463 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:39.545322 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:39.545834 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:39.546269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:39.546966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:39.547417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:39.547943 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:39.551073 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:39.552577 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:39.553766 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1a3e7f02-fb85-4459-87fc-8170926ad257 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1334 microversion: 2.20 time: 0.091679 Aug 23 16:47:39.554325 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 477/967] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:39 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1334 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:39.699149 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:39.707272 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9c730048-239e-4b82-b559-f116628ef349 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1521 microversion: 2.1 time: 0.173688 Aug 23 16:47:39.707841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 491/968] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:39 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:47:40.161717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-183ded7a-9a8b-42b2-8658-be1a9d12ba40 req-8f016651-ba1e-4509-921e-67b54eab5757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6bc7e3a-0456-408f-9de6-b4d4c33413b0", "name": "network-vif-deleted", "tag": "3bf78c41-01be-47d2-b25e-2f22c04fe90d"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:40.172630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-183ded7a-9a8b-42b2-8658-be1a9d12ba40 req-8f016651-ba1e-4509-921e-67b54eab5757 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:40.173165 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-183ded7a-9a8b-42b2-8658-be1a9d12ba40 req-8f016651-ba1e-4509-921e-67b54eab5757 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:40.173631 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-183ded7a-9a8b-42b2-8658-be1a9d12ba40 req-8f016651-ba1e-4509-921e-67b54eab5757 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:40.191545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-183ded7a-9a8b-42b2-8658-be1a9d12ba40 req-8f016651-ba1e-4509-921e-67b54eab5757 service nova] Creating event network-vif-deleted:3bf78c41-01be-47d2-b25e-2f22c04fe90d for instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 on hv-cinder-85032 Aug 23 16:47:40.201232 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-183ded7a-9a8b-42b2-8658-be1a9d12ba40 req-8f016651-ba1e-4509-921e-67b54eab5757 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043186 Aug 23 16:47:40.202297 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 478/969] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:40.577397 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:40.578110 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:40.585032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:40.585539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:40.592125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:40.592125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:40.592125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:40.592125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:40.732763 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:40.733549 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:40.739983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:40.740959 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:40.741540 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:40.742328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:40.743353 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:40.743769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:40.778529 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:40.779013 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:40.779448 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:40.779904 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lazy-loading 'fault' on Instance uuid d6bc7e3a-0456-408f-9de6-b4d4c33413b0 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:47:40.837072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:40.853575 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:40.854189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c9a90fabc0466988ed6bae32beb47f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '102f835e0f424477aab1d540a2a15d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:40.856721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:40.859486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d651a5bc-8bde-4520-8e0a-6bc85aae410d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1407 microversion: 2.20 time: 0.285745 Aug 23 16:47:40.861083 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 492/970] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:40 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:40.883887 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c09a6e6a-b9e5-4771-9ced-710cc99de6c3 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 200 len: 1311 microversion: 2.1 time: 0.155940 Aug 23 16:47:40.896198 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 479/971] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:40 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 1311 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:47:41.746298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-b4e58349-64f0-42f0-8b32-fe7747b60427 req-e5cc834d-46a7-4224-9c3b-50e70482339d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b213d8-efff-4b0b-b552-f0df17286d89", "tag": "bac680e8-6e99-4eba-867d-d2286bd579d0"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:41.760791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-b4e58349-64f0-42f0-8b32-fe7747b60427 req-e5cc834d-46a7-4224-9c3b-50e70482339d service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:41.761551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-b4e58349-64f0-42f0-8b32-fe7747b60427 req-e5cc834d-46a7-4224-9c3b-50e70482339d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:41.762175 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-b4e58349-64f0-42f0-8b32-fe7747b60427 req-e5cc834d-46a7-4224-9c3b-50e70482339d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:41.774763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-b4e58349-64f0-42f0-8b32-fe7747b60427 req-e5cc834d-46a7-4224-9c3b-50e70482339d service nova] Creating event network-changed:bac680e8-6e99-4eba-867d-d2286bd579d0 for instance 91b213d8-efff-4b0b-b552-f0df17286d89 on hv-cinder-85032 Aug 23 16:47:41.779735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-b4e58349-64f0-42f0-8b32-fe7747b60427 req-e5cc834d-46a7-4224-9c3b-50e70482339d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038166 Aug 23 16:47:41.780692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 493/972] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:41.897550 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:41.898169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:41.904973 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:41.905464 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:41.905934 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:41.906646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:41.907132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:41.907561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:41.909169 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:41.909878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] [instance: d6bc7e3a-0456-408f-9de6-b4d4c33413b0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:41.916563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:41.917964 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:41.917964 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:41.918456 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:41.918922 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:41.919390 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:41.934700 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] HTTP exception thrown: Instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 could not be found. Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Request method failure captured: Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 HTTP/1.1 Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKYblaySY69o3r67kZXBryao_JDz8ISrivQ4koxsrmPtheZvDHuaJfkPKyTtGzAPMTZ0C_nBLI8kFRTmhFlEKYQNhz9rpsAUQn2twU4r9ydG41I-t1EJaMk29PXKgrUhqFvE6UV4XUsrtUpM3-SncpZB3kDhTQxJcVSY8_WbTBR_cM Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:47:41.937190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_102f835e0f424477aab1d540a2a15d22", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/102f835e0f424477aab1d540a2a15d22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 102f835e0f424477aab1d540a2a15d22 Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-164416473 Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 50c9a90fabc0466988ed6bae32beb47f Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-ServerRescueNegativeTestJSON-164416473-project Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 could not be found. Aug 23 16:47:41.938813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'd6bc7e3a-0456-408f-9de6-b4d4c33413b0'} Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 could not be found. Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:47:41.939672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 could not be found. Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 could not be found. Aug 23 16:47:41.940982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:47:41.942077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] Returning 404 to user: Instance d6bc7e3a-0456-408f-9de6-b4d4c33413b0 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:47:41.942077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4967c912-e577-4886-bad7-1d2b2d69f636 tempest-ServerRescueNegativeTestJSON-164416473 tempest-ServerRescueNegativeTestJSON-164416473-project] 10.222.0.52 "GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0" status: 404 len: 111 microversion: 2.1 time: 0.033847 Aug 23 16:47:41.942077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 494/973] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:47:41 2022] GET /compute/v2.1/servers/d6bc7e3a-0456-408f-9de6-b4d4c33413b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 16:47:42.134453 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:42.144105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:42.145883 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:42.149967 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e35817f3-491a-417d-863e-8aa0b8c25faa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1407 microversion: 2.20 time: 0.253481 Aug 23 16:47:42.149967 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 480/974] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:41 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:43.170302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:43.171543 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:43.180350 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:43.180840 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:43.181464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:43.182185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:43.182633 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:43.183058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:43.200184 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:43.330348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:43.340286 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:43.342079 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:43.343213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2f2178f9-4556-4d7a-a7a5-3b33d9df8d63 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1407 microversion: 2.20 time: 0.177603 Aug 23 16:47:43.343963 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 495/975] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:43 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:44.365667 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:44.366562 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:44.374519 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:44.375000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:44.375437 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:44.376127 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:44.376736 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:44.377155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:44.532439 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:44.541058 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:44.542596 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:44.543750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2dd23da2-e8f2-4d10-8e8e-ff8006f7f209 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1407 microversion: 2.20 time: 0.182035 Aug 23 16:47:44.544341 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 481/976] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:44 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:45.566628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:45.567866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:45.575581 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:45.576079 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:45.576573 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:45.577295 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:45.577756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:45.578396 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:45.745296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:45.754535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:45.756348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:45.757481 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cd8f65a6-9afb-4b12-a5b5-77507e046477 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1407 microversion: 2.20 time: 0.195239 Aug 23 16:47:45.758754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 496/977] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:45 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:46.779986 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:46.780647 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:46.787382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:46.787856 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:46.788496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:46.789194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:46.789643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:46.790058 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:46.933997 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:46.942789 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:46.944375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:46.951882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3b78e7aa-4762-418b-aed6-bf7f8d7ab589 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1407 microversion: 2.20 time: 0.169612 Aug 23 16:47:46.951882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 482/978] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:46 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:47.576115 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-afae9dd2-1ee9-4f6f-a910-09ccff5cde1e req-0709fa2b-6948-4c0d-b9ea-addadf8e39fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b213d8-efff-4b0b-b552-f0df17286d89", "name": "network-vif-plugged", "status": "completed", "tag": "bac680e8-6e99-4eba-867d-d2286bd579d0"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:47.583585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:47.584376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=6 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:47.590813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-afae9dd2-1ee9-4f6f-a910-09ccff5cde1e req-0709fa2b-6948-4c0d-b9ea-addadf8e39fd service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:47.591425 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-afae9dd2-1ee9-4f6f-a910-09ccff5cde1e req-0709fa2b-6948-4c0d-b9ea-addadf8e39fd service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:47.591718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-afae9dd2-1ee9-4f6f-a910-09ccff5cde1e req-0709fa2b-6948-4c0d-b9ea-addadf8e39fd service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:47.603946 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-afae9dd2-1ee9-4f6f-a910-09ccff5cde1e req-0709fa2b-6948-4c0d-b9ea-addadf8e39fd service nova] Creating event network-vif-plugged:bac680e8-6e99-4eba-867d-d2286bd579d0 for instance 91b213d8-efff-4b0b-b552-f0df17286d89 on hv-cinder-85032 Aug 23 16:47:47.609143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-afae9dd2-1ee9-4f6f-a910-09ccff5cde1e req-0709fa2b-6948-4c0d-b9ea-addadf8e39fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037314 Aug 23 16:47:47.609788 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 497/979] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:47.965043 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:47.972960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:47.972960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:47.976870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:47.977562 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:47.978002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:47.978717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:47.979164 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:47.979588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:48.143294 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:48.152209 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:48.153707 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:48.154814 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8739bbb6-e7cc-406e-9af6-a6b92b76a8da tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1407 microversion: 2.20 time: 0.190654 Aug 23 16:47:48.155352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 483/980] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:47 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:49.177597 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:49.178291 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:49.185664 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:49.186156 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:49.186599 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:49.187302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:49.187766 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:49.188223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:49.324298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:49.337546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:49.339709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:49.340959 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-29adb463-3409-4d36-b918-6d34e61f877c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1407 microversion: 2.20 time: 0.168121 Aug 23 16:47:49.341498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 498/981] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:49 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:50.363660 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:50.364301 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:50.371158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:50.371643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:50.372074 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:50.372810 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:50.373330 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:50.373733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:50.507300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:50.516513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:50.518947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:47:50.521658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c59ae0f9-1ce8-45f3-bd74-d5a93c5488ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1599 microversion: 2.20 time: 0.159778 Aug 23 16:47:50.521658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 484/982] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:47:50 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:47:50.542281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-285ce8e7-bad1-4ed0-8009-6f2b88d2c862 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:50.542777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-285ce8e7-bad1-4ed0-8009-6f2b88d2c862 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:50.549697 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285ce8e7-bad1-4ed0-8009-6f2b88d2c862 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:50.550180 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285ce8e7-bad1-4ed0-8009-6f2b88d2c862 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:50.550619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285ce8e7-bad1-4ed0-8009-6f2b88d2c862 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:50.551318 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285ce8e7-bad1-4ed0-8009-6f2b88d2c862 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:50.551779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285ce8e7-bad1-4ed0-8009-6f2b88d2c862 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:50.552231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285ce8e7-bad1-4ed0-8009-6f2b88d2c862 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:50.638823 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-285ce8e7-bad1-4ed0-8009-6f2b88d2c862 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100480 Aug 23 16:47:50.639416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 499/983] 10.222.0.52 () {60 vars in 1316 bytes} [Tue Aug 23 16:47:50 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:47:51.936369 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-273ca974-9b3a-4b18-b54f-8551e0c3723a req-414ff13b-8966-472a-bb79-d36f83078a1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91b213d8-efff-4b0b-b552-f0df17286d89", "tag": "bac680e8-6e99-4eba-867d-d2286bd579d0"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:51.946701 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-273ca974-9b3a-4b18-b54f-8551e0c3723a req-414ff13b-8966-472a-bb79-d36f83078a1b service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:51.947802 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-273ca974-9b3a-4b18-b54f-8551e0c3723a req-414ff13b-8966-472a-bb79-d36f83078a1b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:51.948367 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-273ca974-9b3a-4b18-b54f-8551e0c3723a req-414ff13b-8966-472a-bb79-d36f83078a1b service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:51.959717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-273ca974-9b3a-4b18-b54f-8551e0c3723a req-414ff13b-8966-472a-bb79-d36f83078a1b service nova] Creating event network-changed:bac680e8-6e99-4eba-867d-d2286bd579d0 for instance 91b213d8-efff-4b0b-b552-f0df17286d89 on hv-cinder-85032 Aug 23 16:47:51.965803 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-273ca974-9b3a-4b18-b54f-8551e0c3723a req-414ff13b-8966-472a-bb79-d36f83078a1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033221 Aug 23 16:47:51.966575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 485/984] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:55.769490 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e68c9070-a162-4bbd-ae84-2e226a664d67 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:47:55.770045 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e68c9070-a162-4bbd-ae84-2e226a664d67 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:55.775860 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e68c9070-a162-4bbd-ae84-2e226a664d67 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:55.776460 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e68c9070-a162-4bbd-ae84-2e226a664d67 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:55.776831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e68c9070-a162-4bbd-ae84-2e226a664d67 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:55.777578 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e68c9070-a162-4bbd-ae84-2e226a664d67 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:55.777993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e68c9070-a162-4bbd-ae84-2e226a664d67 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:55.778425 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e68c9070-a162-4bbd-ae84-2e226a664d67 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:55.802356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e68c9070-a162-4bbd-ae84-2e226a664d67 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/ips" status: 200 len: 150 microversion: 2.1 time: 0.037303 Aug 23 16:47:55.802928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 500/985] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:47:55 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:47:58.504735 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3974e197-3724-4b10-b617-d9b2c15fde11 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86de97ce-4ee0-485d-bf41-f10e364ba3fe"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:47:58.507246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3974e197-3724-4b10-b617-d9b2c15fde11 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:47:58.509746 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:47:58.515613 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3974e197-3724-4b10-b617-d9b2c15fde11 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:58.516210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3974e197-3724-4b10-b617-d9b2c15fde11 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:58.516748 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3974e197-3724-4b10-b617-d9b2c15fde11 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:58.517538 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3974e197-3724-4b10-b617-d9b2c15fde11 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:47:58.517992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3974e197-3724-4b10-b617-d9b2c15fde11 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:47:58.518424 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3974e197-3724-4b10-b617-d9b2c15fde11 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:47:59.305838 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3974e197-3724-4b10-b617-d9b2c15fde11 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805416 Aug 23 16:47:59.306451 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 486/986] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:47:58 2022] POST /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:07.057819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86de97ce-4ee0-485d-bf41-f10e364ba3fe"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:48:07.060152 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:07.062750 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:07.063408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=25 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:07.068051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:07.068587 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:07.069011 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:07.069706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:07.070161 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:07.070586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:07.157987 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Invalid volume: volume 86de97ce-4ee0-485d-bf41-f10e364ba3fe is already attached to instances: 35678a46-44f2-44f5-87d9-4af40d0b7d32 Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: POST /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments HTTP/1.1 Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 74 Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:48:07.159874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {"volumeAttachment": {"volumeId": "86de97ce-4ee0-485d-bf41-f10e364ba3fe"}} Aug 23 16:48:07.161608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Invalid volume: volume 86de97ce-4ee0-485d-bf41-f10e364ba3fe is already attached to instances: 35678a46-44f2-44f5-87d9-4af40d0b7d32 Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'server_id': '35678a46-44f2-44f5-87d9-4af40d0b7d32', 'body': {'volumeAttachment': {'volumeId': '86de97ce-4ee0-485d-bf41-f10e364ba3fe'}}} Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 86de97ce-4ee0-485d-bf41-f10e364ba3fe is already attached to instances: 35678a46-44f2-44f5-87d9-4af40d0b7d32 Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:07.162621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 86de97ce-4ee0-485d-bf41-f10e364ba3fe is already attached to instances: 35678a46-44f2-44f5-87d9-4af40d0b7d32 Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:48:07.164109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:48:07.165706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:48:07.165706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:48:07.165706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:48:07.165706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 86de97ce-4ee0-485d-bf41-f10e364ba3fe is already attached to instances: 35678a46-44f2-44f5-87d9-4af40d0b7d32 Aug 23 16:48:07.165706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:07.165706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 400 to user: Invalid volume: volume 86de97ce-4ee0-485d-bf41-f10e364ba3fe is already attached to instances: 35678a46-44f2-44f5-87d9-4af40d0b7d32 {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:48:07.165706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f28368a1-ea20-464f-a8ad-112a0f23e9ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107537 Aug 23 16:48:07.165706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 501/987] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:48:07 2022] POST /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:48:07.227564 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:07.228279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:07.234956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:07.235434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:07.235861 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:07.236571 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:07.237017 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:07.237430 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:07.318233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lazy-loading 'services' on Instance uuid 35678a46-44f2-44f5-87d9-4af40d0b7d32 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:48:07.558795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-53a8d270-7734-4781-808c-1b01b6fb8f33 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments/86de97ce-4ee0-485d-bf41-f10e364ba3fe" status: 202 len: 0 microversion: 2.1 time: 0.335852 Aug 23 16:48:07.559512 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 487/988] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:48:07 2022] DELETE /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments/86de97ce-4ee0-485d-bf41-f10e364ba3fe => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:48:07.567994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fb2b886d-3df9-4864-a17b-e34be381ef44 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:07.570535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fb2b886d-3df9-4864-a17b-e34be381ef44 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:07.579430 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2b886d-3df9-4864-a17b-e34be381ef44 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:07.579923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2b886d-3df9-4864-a17b-e34be381ef44 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:07.580399 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2b886d-3df9-4864-a17b-e34be381ef44 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:07.581102 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2b886d-3df9-4864-a17b-e34be381ef44 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:07.581561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2b886d-3df9-4864-a17b-e34be381ef44 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:07.581997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2b886d-3df9-4864-a17b-e34be381ef44 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:07.611660 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fb2b886d-3df9-4864-a17b-e34be381ef44 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047641 Aug 23 16:48:07.612242 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 502/989] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:48:07 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:08.624927 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e127b510-34fb-43a6-a35d-b44b3b521bc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:08.627269 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e127b510-34fb-43a6-a35d-b44b3b521bc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:08.634172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e127b510-34fb-43a6-a35d-b44b3b521bc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:08.634661 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e127b510-34fb-43a6-a35d-b44b3b521bc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:08.635594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e127b510-34fb-43a6-a35d-b44b3b521bc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:08.636384 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e127b510-34fb-43a6-a35d-b44b3b521bc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:08.636845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e127b510-34fb-43a6-a35d-b44b3b521bc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:08.637269 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e127b510-34fb-43a6-a35d-b44b3b521bc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:08.668082 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e127b510-34fb-43a6-a35d-b44b3b521bc1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047612 Aug 23 16:48:08.668677 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 488/990] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:48:08 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:09.680392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c76e557d-93b0-4379-b31f-2e43db4e38c3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:09.682561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c76e557d-93b0-4379-b31f-2e43db4e38c3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:09.689629 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c76e557d-93b0-4379-b31f-2e43db4e38c3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:09.690114 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c76e557d-93b0-4379-b31f-2e43db4e38c3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:09.690554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c76e557d-93b0-4379-b31f-2e43db4e38c3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:09.691254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c76e557d-93b0-4379-b31f-2e43db4e38c3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:09.691706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c76e557d-93b0-4379-b31f-2e43db4e38c3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:09.692131 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c76e557d-93b0-4379-b31f-2e43db4e38c3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:09.721989 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c76e557d-93b0-4379-b31f-2e43db4e38c3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045431 Aug 23 16:48:09.722550 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 503/991] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:48:09 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:10.734712 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5b4d32d3-4deb-4d46-9dbd-4cdb98fa549f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:10.736924 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5b4d32d3-4deb-4d46-9dbd-4cdb98fa549f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:10.743384 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b4d32d3-4deb-4d46-9dbd-4cdb98fa549f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:10.743910 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b4d32d3-4deb-4d46-9dbd-4cdb98fa549f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:10.744376 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b4d32d3-4deb-4d46-9dbd-4cdb98fa549f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:10.747236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b4d32d3-4deb-4d46-9dbd-4cdb98fa549f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:10.747236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b4d32d3-4deb-4d46-9dbd-4cdb98fa549f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:10.747236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b4d32d3-4deb-4d46-9dbd-4cdb98fa549f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:10.749158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:10.776443 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5b4d32d3-4deb-4d46-9dbd-4cdb98fa549f tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045967 Aug 23 16:48:10.777003 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 489/992] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:48:10 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:11.788857 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6c00251b-804e-410d-abfd-decb17c93aa8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:11.790993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6c00251b-804e-410d-abfd-decb17c93aa8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:11.797609 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6c00251b-804e-410d-abfd-decb17c93aa8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:11.798091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6c00251b-804e-410d-abfd-decb17c93aa8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:11.798537 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6c00251b-804e-410d-abfd-decb17c93aa8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:11.799229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6c00251b-804e-410d-abfd-decb17c93aa8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:11.799685 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6c00251b-804e-410d-abfd-decb17c93aa8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:11.800112 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6c00251b-804e-410d-abfd-decb17c93aa8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:11.830076 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6c00251b-804e-410d-abfd-decb17c93aa8 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Aug 23 16:48:11.830630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 504/993] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:48:11 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:12.842603 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bdf0f1db-126a-4c5b-90a0-a78b8af36dc0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:12.844885 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bdf0f1db-126a-4c5b-90a0-a78b8af36dc0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:12.852537 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bdf0f1db-126a-4c5b-90a0-a78b8af36dc0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:12.852537 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bdf0f1db-126a-4c5b-90a0-a78b8af36dc0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:12.853005 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bdf0f1db-126a-4c5b-90a0-a78b8af36dc0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:12.853833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bdf0f1db-126a-4c5b-90a0-a78b8af36dc0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:12.854284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bdf0f1db-126a-4c5b-90a0-a78b8af36dc0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:12.854739 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bdf0f1db-126a-4c5b-90a0-a78b8af36dc0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:12.886795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bdf0f1db-126a-4c5b-90a0-a78b8af36dc0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047798 Aug 23 16:48:12.887370 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 490/994] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:48:12 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 16:48:12.949841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:12.950342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:12.956758 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:12.957249 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:12.957688 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:12.958385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:12.958841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:12.959267 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:12.986042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Going to try to terminate instance {{(pid=133198) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:48:13.285862 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d8edde76-28c1-4c86-90df-5481ee41f346 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 204 len: 0 microversion: 2.1 time: 0.339740 Aug 23 16:48:13.286453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 505/995] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:48:12 2022] DELETE /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:48:13.301029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:13.301630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:13.307801 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:13.308308 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:13.308740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:13.309417 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:13.309857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:13.310272 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:13.440887 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:13.449119 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e9c25365-1823-425e-b03e-6dffc8007d1b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1682 microversion: 2.1 time: 0.152202 Aug 23 16:48:13.450120 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 491/996] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:13 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:14.470713 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:14.471336 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:14.477797 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:14.478321 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:14.478765 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:14.479956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:14.480449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:14.480882 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:14.618073 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:14.626396 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-28843281-36f0-4fe6-8eac-4176e1430220 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1682 microversion: 2.1 time: 0.160279 Aug 23 16:48:14.630700 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 506/997] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:14 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:15.647215 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:15.647833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:15.655528 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:15.656013 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:15.663014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:15.663014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:15.663014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:15.663014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:15.867923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:15.877198 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-40138541-2a53-441a-9b6d-7e5c39bf3b0a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1682 microversion: 2.1 time: 0.233873 Aug 23 16:48:15.877781 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 492/998] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:15 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1682 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:16.318325 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-61aeb3ab-7918-4c9e-abf5-eca71a33f3cb req-445edd02-7e86-44e0-b92f-ed26a0b2a742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35678a46-44f2-44f5-87d9-4af40d0b7d32", "name": "network-vif-deleted", "tag": "c6fa608b-4c82-4b90-ae75-a59025725505"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:48:16.328334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-61aeb3ab-7918-4c9e-abf5-eca71a33f3cb req-445edd02-7e86-44e0-b92f-ed26a0b2a742 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:16.328872 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-61aeb3ab-7918-4c9e-abf5-eca71a33f3cb req-445edd02-7e86-44e0-b92f-ed26a0b2a742 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:16.329307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-61aeb3ab-7918-4c9e-abf5-eca71a33f3cb req-445edd02-7e86-44e0-b92f-ed26a0b2a742 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:16.341498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-61aeb3ab-7918-4c9e-abf5-eca71a33f3cb req-445edd02-7e86-44e0-b92f-ed26a0b2a742 service nova] Creating event network-vif-deleted:c6fa608b-4c82-4b90-ae75-a59025725505 for instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 on hv-cinder-85032 Aug 23 16:48:16.346483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-61aeb3ab-7918-4c9e-abf5-eca71a33f3cb req-445edd02-7e86-44e0-b92f-ed26a0b2a742 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032695 Aug 23 16:48:16.347075 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 507/999] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:16.899565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:16.901074 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:16.908849 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:16.909342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:16.909807 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:16.910707 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:16.911454 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:16.912050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:16.945897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:16.946387 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:16.946823 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:16.947283 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lazy-loading 'fault' on Instance uuid 35678a46-44f2-44f5-87d9-4af40d0b7d32 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:48:16.991858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:17.000194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5affd1ab-d846-471f-83b5-1fa2b697b787 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 200 len: 1331 microversion: 2.1 time: 0.104943 Aug 23 16:48:17.000976 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 493/1000] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:16 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:18.022574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:18.023436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:18.030056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:18.030650 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:18.031165 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:18.032148 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:18.032568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:18.033003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:18.046901 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 HTTP/1.1 Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:48:18.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:48:18.050181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '35678a46-44f2-44f5-87d9-4af40d0b7d32'} Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:48:18.051087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:48:18.052642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:48:18.054190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:48:18.054190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-244be71c-ffc7-41f7-9b0a-d66ada6b5463 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 404 len: 111 microversion: 2.1 time: 0.032407 Aug 23 16:48:18.054190 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 508/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:18 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:48:18.060180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-823ca649-0637-4eba-a5c9-ad51a73d9dae tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '.version_select at 0x7f677c94ddc0>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:18.165515 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-823ca649-0637-4eba-a5c9-ad51a73d9dae tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-351151624" status: 202 len: 0 microversion: 2.1 time: 0.109927 Aug 23 16:48:18.166123 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 494/1002] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Aug 23 16:48:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-351151624 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:48:18.999164 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-13975851-daac-4f27-b27a-b2afb0356fd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: .version_select at 0x7f677c9ffdc0>, body: {"keypair": {"name": "tempest-keypair-1006591027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7r1Sr3C1N5EykxFoNXRx041H66nRDaP8IOmGHRpadagxXpaU1r5viSvsvlnZV+gmQ6ci0CIUqsyG6nCPZb0KjmxoSxCbfrRQS+7Z2vGQLVYuSGpJJDK9+XhKaa/Umhsw=="}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:48:19.014885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-13975851-daac-4f27-b27a-b2afb0356fd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:48:19.024715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-13975851-daac-4f27-b27a-b2afb0356fd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for user a642d26e91c8449296a7a6733221824f and project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:48:19.125545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-13975851-daac-4f27-b27a-b2afb0356fd9 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130352 Aug 23 16:48:19.126141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 509/1003] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:48:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:21.821858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1214192060", "imageRef": "c7b7c460-fb55-4d92-979d-022f44f7344a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8232e7cf-7851-4756-8389-6e87e5a21279"}], "security_groups": [{"name": "tempest-securitygroup--1496754845"}], "key_name": "tempest-keypair-1006591027", "user_data": "}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:48:21.926799 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] validate_networks() for [('8232e7cf-7851-4756-8389-6e87e5a21279', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:48:22.314897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:48:22.315465 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:48:22.315778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:48:22.316405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:48:22.316852 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:48:22.329421 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:22.329898 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:22.330329 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:22.331052 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:22.331501 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:22.331915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:22.348819 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:48:22.352836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Getting quotas for user a642d26e91c8449296a7a6733221824f and project 3b2175d3e8444292aac6cd003b0668d8. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:48:22.364018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:48:22.366788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7b7c460-fb55-4d92-979d-022f44f7344a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:48:22.523404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-679fe5fb-acf9-4534-aeb5-4ea1a9a79234 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.706493 Aug 23 16:48:22.524583 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 495/1004] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:48:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:48:22.536620 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-192dd204-35b3-418f-a5b8-aa4ef2514780 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:22.537381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-192dd204-35b3-418f-a5b8-aa4ef2514780 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:22.601948 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-192dd204-35b3-418f-a5b8-aa4ef2514780 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:22.611290 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-192dd204-35b3-418f-a5b8-aa4ef2514780 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1242 microversion: 2.1 time: 0.079115 Aug 23 16:48:22.611931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 510/1005] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:22 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:23.633346 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:23.633908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:23.640324 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:23.640833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:23.641262 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:23.641956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:23.642401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:23.642846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:23.704097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:23.712090 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-687402e7-a927-476c-a5af-28a49b9aad89 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1246 microversion: 2.1 time: 0.083647 Aug 23 16:48:23.712663 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 496/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:23 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:24.735215 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:24.735846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:24.743271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:24.745978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:24.745978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:24.745978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:24.745978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:24.746337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:24.813305 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:24.820937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-718b54fc-5673-4a0e-b1e2-ac7d0b20cbe3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1302 microversion: 2.1 time: 0.090099 Aug 23 16:48:24.821510 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 511/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:24 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1302 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:25.842161 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:25.842670 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:25.852646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:25.853752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:25.854834 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:25.855632 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:25.856364 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:25.856800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:26.077618 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:26.085372 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9159876c-948c-4798-aed7-c679ecf1239c tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1368 microversion: 2.1 time: 0.247477 Aug 23 16:48:26.085945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 497/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:25 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:26.268995 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-8aee9e88-6b1d-44b9-a1b2-0a4521571633 req-96ce9ed1-d555-4d14-b96c-26cc00461ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9d9c40-70f0-47d7-912c-d3ded849b68c", "tag": "298636c9-04a5-4ea8-b191-a4ffc865d9fc"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:48:26.281223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-8aee9e88-6b1d-44b9-a1b2-0a4521571633 req-96ce9ed1-d555-4d14-b96c-26cc00461ef2 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:26.281883 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-8aee9e88-6b1d-44b9-a1b2-0a4521571633 req-96ce9ed1-d555-4d14-b96c-26cc00461ef2 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:26.282475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-8aee9e88-6b1d-44b9-a1b2-0a4521571633 req-96ce9ed1-d555-4d14-b96c-26cc00461ef2 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:26.299150 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-8aee9e88-6b1d-44b9-a1b2-0a4521571633 req-96ce9ed1-d555-4d14-b96c-26cc00461ef2 service nova] Creating event network-changed:298636c9-04a5-4ea8-b191-a4ffc865d9fc for instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c on hv-cinder-85032 Aug 23 16:48:26.299708 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-8aee9e88-6b1d-44b9-a1b2-0a4521571633 req-96ce9ed1-d555-4d14-b96c-26cc00461ef2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035465 Aug 23 16:48:26.300750 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 512/1009] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:48:27.108977 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:27.109665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:27.116171 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:27.116664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:27.117233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:27.117775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:27.118234 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:27.118638 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:27.290283 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:27.299862 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8a693911-f395-45d0-aa4f-3a03218486f5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1368 microversion: 2.1 time: 0.195117 Aug 23 16:48:27.300527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 498/1010] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:27 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:28.321606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:28.322302 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:28.329687 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:28.330183 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:28.330618 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:28.331313 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:28.331773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:28.332226 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:28.467295 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:28.474899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cdb1cc90-d063-4054-a055-f1207ff53368 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1368 microversion: 2.1 time: 0.157568 Aug 23 16:48:28.475464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 513/1011] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:28 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:29.494928 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:29.495543 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:29.497918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:29.502616 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:29.503105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:29.503588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:29.504334 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:29.504785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:29.508540 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:29.648897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:29.658280 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8788342f-74e5-4fdf-aedb-f528440fb912 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1368 microversion: 2.1 time: 0.167031 Aug 23 16:48:29.658975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 499/1012] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:29 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:30.678922 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:30.679547 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:30.686163 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:30.686644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:30.687077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:30.687765 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:30.688251 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:30.688729 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:30.826643 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:30.834464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5ca78271-b984-408a-91ec-cbd836c95db6 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1368 microversion: 2.1 time: 0.159521 Aug 23 16:48:30.835026 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 514/1013] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:30 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:31.800434 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-adfcc372-070c-4517-93c5-c929ed1e3575 req-d27bb79f-8dcd-416d-940d-9a639d4fab1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9d9c40-70f0-47d7-912c-d3ded849b68c", "name": "network-vif-plugged", "status": "completed", "tag": "298636c9-04a5-4ea8-b191-a4ffc865d9fc"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:48:31.812693 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-adfcc372-070c-4517-93c5-c929ed1e3575 req-d27bb79f-8dcd-416d-940d-9a639d4fab1d service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:31.813184 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-adfcc372-070c-4517-93c5-c929ed1e3575 req-d27bb79f-8dcd-416d-940d-9a639d4fab1d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:31.813613 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-adfcc372-070c-4517-93c5-c929ed1e3575 req-d27bb79f-8dcd-416d-940d-9a639d4fab1d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:31.825125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-adfcc372-070c-4517-93c5-c929ed1e3575 req-d27bb79f-8dcd-416d-940d-9a639d4fab1d service nova] Creating event network-vif-plugged:298636c9-04a5-4ea8-b191-a4ffc865d9fc for instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c on hv-cinder-85032 Aug 23 16:48:31.830331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-adfcc372-070c-4517-93c5-c929ed1e3575 req-d27bb79f-8dcd-416d-940d-9a639d4fab1d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034009 Aug 23 16:48:31.831078 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 500/1014] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:31.855246 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:31.856555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:31.863404 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:31.863893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:31.864441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:31.865060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:31.865602 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:31.866033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:32.015954 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:32.023608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-28b7f689-37d4-429c-be95-8bdc5e6ca4fe tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1368 microversion: 2.1 time: 0.172564 Aug 23 16:48:32.030010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 515/1015] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:31 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:33.046132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:33.046917 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:33.051435 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:33.052138 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:33.058329 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:33.058831 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:33.059312 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:33.060511 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:33.060977 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:33.061415 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:33.195712 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:33.203542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-7371b642-e0a3-40f5-a2b8-2e3460bbd16b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1368 microversion: 2.1 time: 0.158341 Aug 23 16:48:33.204105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 501/1016] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:33 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:34.224548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:34.225181 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:34.227139 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=6 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:34.232644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:34.233121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:34.233553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:34.234233 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:34.234682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:34.235099 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:34.561316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:34.568905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8907d6be-11fb-44f4-9f4c-d9bf2ab0193b tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1368 microversion: 2.1 time: 0.348344 Aug 23 16:48:34.569497 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 516/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:34 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1368 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:35.590464 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:35.591834 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:35.598565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:35.599137 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:35.599675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:35.600477 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:35.601001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:35.601498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:35.789371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:48:35.797081 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6b9bdb03-4671-4305-afb1-9aa8eedb5b8d tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1558 microversion: 2.1 time: 0.210468 Aug 23 16:48:35.797627 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 502/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:48:35 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:48:35.819171 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-68cf0e13-98f2-426d-8b82-5fa9749ced01 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:35.819776 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-68cf0e13-98f2-426d-8b82-5fa9749ced01 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:35.826668 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-68cf0e13-98f2-426d-8b82-5fa9749ced01 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:35.827151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-68cf0e13-98f2-426d-8b82-5fa9749ced01 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:35.827590 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-68cf0e13-98f2-426d-8b82-5fa9749ced01 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:35.828403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-68cf0e13-98f2-426d-8b82-5fa9749ced01 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:35.828860 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-68cf0e13-98f2-426d-8b82-5fa9749ced01 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:35.829289 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-68cf0e13-98f2-426d-8b82-5fa9749ced01 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:35.905354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-68cf0e13-98f2-426d-8b82-5fa9749ced01 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090652 Aug 23 16:48:35.912306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 517/1019] 10.222.0.52 () {58 vars in 1275 bytes} [Tue Aug 23 16:48:35 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:36.890236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-391e1564-b666-4a27-a9a1-f14c7cc33460 req-3c34fbe0-791a-4fdd-a7a8-81049bbcd43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9d9c40-70f0-47d7-912c-d3ded849b68c", "tag": "298636c9-04a5-4ea8-b191-a4ffc865d9fc"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:48:36.901842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-391e1564-b666-4a27-a9a1-f14c7cc33460 req-3c34fbe0-791a-4fdd-a7a8-81049bbcd43e service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:36.901842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-391e1564-b666-4a27-a9a1-f14c7cc33460 req-3c34fbe0-791a-4fdd-a7a8-81049bbcd43e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:36.901842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-391e1564-b666-4a27-a9a1-f14c7cc33460 req-3c34fbe0-791a-4fdd-a7a8-81049bbcd43e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:36.916029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-391e1564-b666-4a27-a9a1-f14c7cc33460 req-3c34fbe0-791a-4fdd-a7a8-81049bbcd43e service nova] Creating event network-changed:298636c9-04a5-4ea8-b191-a4ffc865d9fc for instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c on hv-cinder-85032 Aug 23 16:48:36.921124 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-391e1564-b666-4a27-a9a1-f14c7cc33460 req-3c34fbe0-791a-4fdd-a7a8-81049bbcd43e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035016 Aug 23 16:48:36.922177 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 503/1020] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:43.541339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-12cda5cb-af62-451b-a672-ec8d59f28a17 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:43.541900 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-12cda5cb-af62-451b-a672-ec8d59f28a17 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:43.543736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:43.549103 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12cda5cb-af62-451b-a672-ec8d59f28a17 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:43.549587 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12cda5cb-af62-451b-a672-ec8d59f28a17 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:43.550026 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12cda5cb-af62-451b-a672-ec8d59f28a17 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:43.550720 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12cda5cb-af62-451b-a672-ec8d59f28a17 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:43.551176 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12cda5cb-af62-451b-a672-ec8d59f28a17 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:43.551603 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12cda5cb-af62-451b-a672-ec8d59f28a17 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:43.554022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:43.575237 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-12cda5cb-af62-451b-a672-ec8d59f28a17 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/ips" status: 200 len: 146 microversion: 2.1 time: 0.038309 Aug 23 16:48:43.579815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 518/1021] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:48:43 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:46.242943 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-753a0b45-4310-40fa-badb-ccaea59036bd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1b0eb6d-0997-4f66-ae27-83ea936de784"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:48:46.245426 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-753a0b45-4310-40fa-badb-ccaea59036bd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:46.251633 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-753a0b45-4310-40fa-badb-ccaea59036bd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:46.252143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-753a0b45-4310-40fa-badb-ccaea59036bd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:46.252611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-753a0b45-4310-40fa-badb-ccaea59036bd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:46.253306 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-753a0b45-4310-40fa-badb-ccaea59036bd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:46.253755 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-753a0b45-4310-40fa-badb-ccaea59036bd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:46.254208 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-753a0b45-4310-40fa-badb-ccaea59036bd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:46.257903 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=74 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:48:47.077466 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-753a0b45-4310-40fa-badb-ccaea59036bd tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839475 Aug 23 16:48:47.078104 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 504/1022] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:48:46 2022] POST /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:55.687528 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2068693b-5bfc-4e93-896b-50c7f8183eb0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:55.689976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2068693b-5bfc-4e93-896b-50c7f8183eb0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:55.697096 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2068693b-5bfc-4e93-896b-50c7f8183eb0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:55.697586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2068693b-5bfc-4e93-896b-50c7f8183eb0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:55.698039 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2068693b-5bfc-4e93-896b-50c7f8183eb0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:55.698743 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2068693b-5bfc-4e93-896b-50c7f8183eb0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:55.699205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2068693b-5bfc-4e93-896b-50c7f8183eb0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:55.699670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2068693b-5bfc-4e93-896b-50c7f8183eb0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:55.736716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2068693b-5bfc-4e93-896b-50c7f8183eb0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054559 Aug 23 16:48:55.737617 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 519/1023] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:48:55 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:55.749800 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-10591fc5-c20e-4c03-b2ed-7601ee697770 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:48:55.750327 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-10591fc5-c20e-4c03-b2ed-7601ee697770 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:55.756940 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10591fc5-c20e-4c03-b2ed-7601ee697770 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:55.757362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10591fc5-c20e-4c03-b2ed-7601ee697770 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:55.757799 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10591fc5-c20e-4c03-b2ed-7601ee697770 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:55.758498 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10591fc5-c20e-4c03-b2ed-7601ee697770 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:55.759082 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10591fc5-c20e-4c03-b2ed-7601ee697770 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:55.759506 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-10591fc5-c20e-4c03-b2ed-7601ee697770 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:55.791230 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-10591fc5-c20e-4c03-b2ed-7601ee697770 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/f1b0eb6d-0997-4f66-ae27-83ea936de784" status: 200 len: 194 microversion: 2.1 time: 0.047025 Aug 23 16:48:55.791997 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 505/1024] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Aug 23 16:48:55 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/f1b0eb6d-0997-4f66-ae27-83ea936de784 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:48:58.473753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-67b35f79-9e6d-4f7b-92a2-2491e459bdc3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14f7b5b0-2b72-48cb-b440-a32995dcde76"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:48:58.476072 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-67b35f79-9e6d-4f7b-92a2-2491e459bdc3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:48:58.483584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-67b35f79-9e6d-4f7b-92a2-2491e459bdc3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:58.484069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-67b35f79-9e6d-4f7b-92a2-2491e459bdc3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:58.484535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-67b35f79-9e6d-4f7b-92a2-2491e459bdc3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:58.485237 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-67b35f79-9e6d-4f7b-92a2-2491e459bdc3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:48:58.485692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-67b35f79-9e6d-4f7b-92a2-2491e459bdc3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:48:58.486122 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-67b35f79-9e6d-4f7b-92a2-2491e459bdc3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:48:59.266454 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-67b35f79-9e6d-4f7b-92a2-2491e459bdc3 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "POST /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796873 Aug 23 16:48:59.267067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 520/1025] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:48:58 2022] POST /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:49:07.140861 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bb965d49-7d07-4f78-8198-0bf27a1c37ce tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:07.141438 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bb965d49-7d07-4f78-8198-0bf27a1c37ce tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:07.143962 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=13 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:07.144670 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:07.149467 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb965d49-7d07-4f78-8198-0bf27a1c37ce tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:07.149981 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb965d49-7d07-4f78-8198-0bf27a1c37ce tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:07.150464 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb965d49-7d07-4f78-8198-0bf27a1c37ce tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:07.151241 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb965d49-7d07-4f78-8198-0bf27a1c37ce tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:07.151615 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb965d49-7d07-4f78-8198-0bf27a1c37ce tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:07.152039 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb965d49-7d07-4f78-8198-0bf27a1c37ce tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:07.176211 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bb965d49-7d07-4f78-8198-0bf27a1c37ce tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/ips" status: 200 len: 150 microversion: 2.20 time: 0.039990 Aug 23 16:49:07.176718 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 506/1026] 10.222.0.52 () {60 vars in 1289 bytes} [Tue Aug 23 16:49:07 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:49:07.849034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ae5e3c8d-368d-46b4-a259-efb21641eeea tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:07.851360 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ae5e3c8d-368d-46b4-a259-efb21641eeea tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:07.857813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae5e3c8d-368d-46b4-a259-efb21641eeea tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:07.862402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae5e3c8d-368d-46b4-a259-efb21641eeea tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:07.862402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae5e3c8d-368d-46b4-a259-efb21641eeea tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:07.862402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae5e3c8d-368d-46b4-a259-efb21641eeea tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:07.862402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae5e3c8d-368d-46b4-a259-efb21641eeea tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:07.862772 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ae5e3c8d-368d-46b4-a259-efb21641eeea tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:07.891002 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ae5e3c8d-368d-46b4-a259-efb21641eeea tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046833 Aug 23 16:49:07.891555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 521/1027] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:49:07 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:49:08.037407 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-20bbf531-7e1a-4c52-ab82-89befd9a11b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:08.037889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-20bbf531-7e1a-4c52-ab82-89befd9a11b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:08.044509 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20bbf531-7e1a-4c52-ab82-89befd9a11b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:08.044983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20bbf531-7e1a-4c52-ab82-89befd9a11b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:08.045409 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20bbf531-7e1a-4c52-ab82-89befd9a11b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:08.046736 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20bbf531-7e1a-4c52-ab82-89befd9a11b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:08.047181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20bbf531-7e1a-4c52-ab82-89befd9a11b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:08.047596 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20bbf531-7e1a-4c52-ab82-89befd9a11b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:08.076008 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-20bbf531-7e1a-4c52-ab82-89befd9a11b9 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/f1b0eb6d-0997-4f66-ae27-83ea936de784" status: 200 len: 194 microversion: 2.1 time: 0.042858 Aug 23 16:49:08.076815 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 507/1028] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Aug 23 16:49:08 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/f1b0eb6d-0997-4f66-ae27-83ea936de784 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:49:08.086974 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:08.089246 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:08.093835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:08.094315 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:08.094753 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:08.095442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:08.095899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:08.096353 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:08.176041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lazy-loading 'services' on Instance uuid bc849ee7-f7a6-479e-823a-928a7a5c22aa {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:49:08.381184 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6cc67a41-7874-48e0-9530-b1e883724f2b tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/f1b0eb6d-0997-4f66-ae27-83ea936de784" status: 202 len: 0 microversion: 2.1 time: 0.297955 Aug 23 16:49:08.381952 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 522/1029] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:49:08 2022] DELETE /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/f1b0eb6d-0997-4f66-ae27-83ea936de784 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:49:10.360391 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:49:10.360928 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:10.367666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:10.379199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:10.379199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:10.379199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:10.379199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:10.379663 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:10.392700 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lazy-loading 'flavor' on Instance uuid 91b213d8-efff-4b0b-b552-f0df17286d89 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:49:10.555321 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9e26877d-7546-4d2f-a1e5-c613128da479 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:10.555894 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9e26877d-7546-4d2f-a1e5-c613128da479 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:10.562853 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e26877d-7546-4d2f-a1e5-c613128da479 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:10.563338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e26877d-7546-4d2f-a1e5-c613128da479 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:10.563785 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e26877d-7546-4d2f-a1e5-c613128da479 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:10.564502 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e26877d-7546-4d2f-a1e5-c613128da479 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:10.564953 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e26877d-7546-4d2f-a1e5-c613128da479 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:10.565379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9e26877d-7546-4d2f-a1e5-c613128da479 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:10.598341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9e26877d-7546-4d2f-a1e5-c613128da479 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/14f7b5b0-2b72-48cb-b440-a32995dcde76" status: 200 len: 194 microversion: 2.1 time: 0.047262 Aug 23 16:49:10.598967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 523/1030] 10.222.0.52 () {58 vars in 1413 bytes} [Tue Aug 23 16:49:10 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/14f7b5b0-2b72-48cb-b440-a32995dcde76 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:49:10.609657 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:10.610085 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:10.624090 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:10.624090 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:10.624090 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:10.624090 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:10.624746 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:10.624746 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:10.703352 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lazy-loading 'services' on Instance uuid bc849ee7-f7a6-479e-823a-928a7a5c22aa {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:49:10.844403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9b7a49f2-ce48-4be3-8013-1f06d4924c04 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/action" status: 202 len: 0 microversion: 2.20 time: 0.489253 Aug 23 16:49:10.845216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 508/1031] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 23 16:49:10 2022] POST /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:49:10.853418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:10.854106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:10.860690 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:10.861172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:10.861606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:10.862297 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:10.862742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:10.863160 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:10.928911 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-29a183a4-2f7b-4e6d-abc6-853d8c7a7262 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/14f7b5b0-2b72-48cb-b440-a32995dcde76" status: 202 len: 0 microversion: 2.1 time: 0.322960 Aug 23 16:49:10.929540 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 524/1032] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:49:10 2022] DELETE /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments/14f7b5b0-2b72-48cb-b440-a32995dcde76 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 16:49:11.005740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:11.012495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:11.014033 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:11.016039 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f189b8cd-1868-4607-9a60-89f2d674888a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.166773 Aug 23 16:49:11.016644 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 509/1033] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:10 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:49:12.039466 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:12.040195 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:12.047437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:12.048060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:12.048457 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:12.049236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:12.049641 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:12.050062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:12.180441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:12.189265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:12.191345 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:12.191955 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fc3c60e8-5df2-4152-a0d3-c78e30f3658c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.157321 Aug 23 16:49:12.192551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 525/1034] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:12 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:13.162036 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-437ef97f-007e-4f30-87dd-d1d53e9d0e00 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:13.164399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-437ef97f-007e-4f30-87dd-d1d53e9d0e00 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:13.171537 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-437ef97f-007e-4f30-87dd-d1d53e9d0e00 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.172022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-437ef97f-007e-4f30-87dd-d1d53e9d0e00 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.172482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-437ef97f-007e-4f30-87dd-d1d53e9d0e00 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.173295 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-437ef97f-007e-4f30-87dd-d1d53e9d0e00 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.173749 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-437ef97f-007e-4f30-87dd-d1d53e9d0e00 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.174176 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-437ef97f-007e-4f30-87dd-d1d53e9d0e00 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.202818 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-437ef97f-007e-4f30-87dd-d1d53e9d0e00 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044814 Aug 23 16:49:13.203364 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 510/1035] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:49:13 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 16:49:13.214561 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:13.215173 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:13.222339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.222823 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.223257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.224059 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.224554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.224978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.316676 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-539f54b0-4425-4a33-8288-fe3c8ab2d43d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:13.318757 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-539f54b0-4425-4a33-8288-fe3c8ab2d43d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:13.324804 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-539f54b0-4425-4a33-8288-fe3c8ab2d43d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.325281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-539f54b0-4425-4a33-8288-fe3c8ab2d43d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.325705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-539f54b0-4425-4a33-8288-fe3c8ab2d43d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.326390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-539f54b0-4425-4a33-8288-fe3c8ab2d43d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.326836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-539f54b0-4425-4a33-8288-fe3c8ab2d43d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.327282 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-539f54b0-4425-4a33-8288-fe3c8ab2d43d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.359105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-539f54b0-4425-4a33-8288-fe3c8ab2d43d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045799 Aug 23 16:49:13.359683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 511/1036] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:49:13 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 16:49:13.361204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:13.369766 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:13.371254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:13.372436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a8350700-f544-46dd-8110-8e91cd6ecd0b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.161676 Aug 23 16:49:13.372992 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 526/1037] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:13 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:13.420239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:13.420736 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:13.427357 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.427839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.428303 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.429023 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.429478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.429905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.454030 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:49:13.735733 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1237f313-ac87-4a14-9bf8-1941711b5669 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 204 len: 0 microversion: 2.1 time: 0.319005 Aug 23 16:49:13.736358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 512/1038] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:49:13 2022] DELETE /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:49:13.744851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:13.745550 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:13.751470 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.751951 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.752413 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.753104 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:13.753560 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:13.753984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:13.883718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:13.892104 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b6ded3e6-8e19-4cb4-a3e0-0d62b5dc2b4d tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1672 microversion: 2.1 time: 0.151151 Aug 23 16:49:13.892634 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 527/1039] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:49:13 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:49:14.395850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:14.396574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:14.402947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:14.403433 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:14.403872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:14.404587 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:14.405044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:14.405470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:14.534283 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:14.542372 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:14.543879 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:14.545158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8bb884ac-4d09-47e2-b8ad-45a886f7cf3a tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.154111 Aug 23 16:49:14.545726 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 513/1040] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:14 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:14.912676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:14.913297 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:14.919705 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:14.920221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:14.920671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:14.921370 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:14.921830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:14.922301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:15.052783 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:15.060486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ccf860e8-3115-4fbe-9ffe-0a8751f22305 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1672 microversion: 2.1 time: 0.151639 Aug 23 16:49:15.061053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 528/1041] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:49:14 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:49:15.567706 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:15.568409 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:15.574851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:15.575334 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:15.575767 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:15.576501 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:15.576955 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:15.577437 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:15.714995 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:15.724608 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:15.726104 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:15.727263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-602a80a6-1b2e-4b05-b98d-85d893567733 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.163514 Aug 23 16:49:15.728008 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 514/1042] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:15 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:16.082264 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:16.082808 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:16.089121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:16.089601 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:16.090035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:16.090719 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:16.091169 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:16.091590 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:16.297714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:16.305541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2a1edfbf-1950-4de9-822c-0217881b3cdb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1672 microversion: 2.1 time: 0.227661 Aug 23 16:49:16.306114 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 529/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:49:16 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1672 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:49:16.751729 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:16.752444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:16.759078 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:16.759482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:16.759919 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:16.760633 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:16.761093 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:16.761516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:16.950566 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:16.959304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:16.960888 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:16.962054 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c2fe94aa-09bb-40ec-9c32-6917a7d5e635 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.215286 Aug 23 16:49:16.962615 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 515/1044] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:16 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:17.327257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:17.329433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:17.336069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:17.336714 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:17.337255 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:17.338055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:17.338608 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:17.339176 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:17.368471 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-ca293664-7d6d-4f82-b113-a2cf1ab91bbf req-419f74ca-3bd7-43f5-b7b7-c3eb6f42df39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc849ee7-f7a6-479e-823a-928a7a5c22aa", "name": "network-vif-deleted", "tag": "8d99ff1c-cc20-428a-8094-0934e067d97c"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:49:17.380833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ca293664-7d6d-4f82-b113-a2cf1ab91bbf req-419f74ca-3bd7-43f5-b7b7-c3eb6f42df39 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:17.381669 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ca293664-7d6d-4f82-b113-a2cf1ab91bbf req-419f74ca-3bd7-43f5-b7b7-c3eb6f42df39 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:17.382102 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ca293664-7d6d-4f82-b113-a2cf1ab91bbf req-419f74ca-3bd7-43f5-b7b7-c3eb6f42df39 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:17.395304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-ca293664-7d6d-4f82-b113-a2cf1ab91bbf req-419f74ca-3bd7-43f5-b7b7-c3eb6f42df39 service nova] Creating event network-vif-deleted:8d99ff1c-cc20-428a-8094-0934e067d97c for instance bc849ee7-f7a6-479e-823a-928a7a5c22aa on hv-cinder-85032 Aug 23 16:49:17.401373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-ca293664-7d6d-4f82-b113-a2cf1ab91bbf req-419f74ca-3bd7-43f5-b7b7-c3eb6f42df39 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035769 Aug 23 16:49:17.401373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 516/1045] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:49:17.426211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cbfcfbe01834b9ab9179bc032db813e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97dc90210f5845e98a6bdb51aaef3518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:17.436832 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0efc8bd0-72b7-4efa-a270-9a29b1e558aa tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 200 len: 1605 microversion: 2.1 time: 0.113506 Aug 23 16:49:17.451588 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 530/1046] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:49:17 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 1605 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:49:17.986364 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:17.987091 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:17.993322 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:17.993808 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:17.994238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:17.994927 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:17.995379 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:17.995803 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:18.134637 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:18.143630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:18.145152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:18.146314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b59ffe5d-4b6d-4f0a-9d22-dbe3e88e7a8e tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.165147 Aug 23 16:49:18.147116 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 517/1047] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:17 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:18.458656 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:18.459400 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:18.466029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:18.471432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:18.471432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:18.471432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:18.471432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:18.471785 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:18.483326 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] HTTP exception thrown: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Request method failure captured: Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa HTTP/1.1 Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKZJT5_KBwniMpNChZlu6CGRNF2hhZLg2Ormg3kaO5WXcYmjJXrI7VUMclf9bLxvWD4lcCF-Nu4gL27OB6fiMYb5DrXnLw4vcLwJsCUJYkPQyLamDxGAiyAmSrt5SECCwe65w1uh5y0nLV_zobWVMFl_BJ6XZ4vmmSaj1dYBy7cNkI Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:49:18.485091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97dc90210f5845e98a6bdb51aaef3518", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 5cbfcfbe01834b9ab9179bc032db813e Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:18.486754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'bc849ee7-f7a6-479e-823a-928a7a5c22aa'} Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:49:18.487556 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:18.488908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:18.490054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Returning 404 to user: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:49:18.490054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-54f05aea-159f-4809-a0f1-9e9e6cad28c0 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 404 len: 111 microversion: 2.1 time: 0.031801 Aug 23 16:49:18.490054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 531/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:49:18 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:49:18.495585 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-78aaad38-9941-4e50-8216-648302b90226 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '.version_select at 0x7f6778176430>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:18.571742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-78aaad38-9941-4e50-8216-648302b90226 tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653487850" status: 202 len: 0 microversion: 2.1 time: 0.079883 Aug 23 16:49:18.572522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 518/1049] 10.222.0.52 () {58 vars in 1218 bytes} [Tue Aug 23 16:49:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653487850 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:49:19.169795 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:19.170391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:19.176520 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:19.176999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:19.177431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:19.178149 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:19.178634 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:19.179057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:19.323834 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:19.331436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:19.332999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:19.334455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-28e85a5a-64f5-4d9e-a6ac-c4b2ad206f95 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.168669 Aug 23 16:49:19.335088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 532/1050] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:19 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:20.357113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:20.358027 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:20.364791 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:20.365272 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:20.365703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:20.366437 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:20.366891 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:20.367317 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:20.499213 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:20.507450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:20.509002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:20.510175 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b50724c6-5f49-4c03-a1a4-a1c97f3be98d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.157059 Aug 23 16:49:20.510774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 519/1051] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:20 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:21.533874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:21.534490 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:21.541012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:21.541496 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:21.541956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:21.542650 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:21.543104 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:21.543535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:21.546296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:21.681283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:21.690590 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:21.692069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:21.693250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5845ef5a-f74b-4fb3-832e-eac3f0213548 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.163811 Aug 23 16:49:21.693796 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 533/1052] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:21 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:49:21.879706 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:21.880228 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:21.886873 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:21.887361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:21.887826 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:21.888554 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:21.889011 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:21.889438 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:21.902699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] HTTP exception thrown: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Request method failure captured: Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: DELETE /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa HTTP/1.1 Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKZJT5_KBwniMpNChZlu6CGRNF2hhZLg2Ormg3kaO5WXcYmjJXrI7VUMclf9bLxvWD4lcCF-Nu4gL27OB6fiMYb5DrXnLw4vcLwJsCUJYkPQyLamDxGAiyAmSrt5SECCwe65w1uh5y0nLV_zobWVMFl_BJ6XZ4vmmSaj1dYBy7cNkI Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:49:21.904436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97dc90210f5845e98a6bdb51aaef3518", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 5cbfcfbe01834b9ab9179bc032db813e Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.906001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': 'bc849ee7-f7a6-479e-823a-928a7a5c22aa'} Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:49:21.906871 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.908152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.909816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Returning 404 to user: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:49:21.909816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-515c9fd7-3229-433d-9f88-8d9cfab5426a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 404 len: 111 microversion: 2.1 time: 0.030628 Aug 23 16:49:21.909816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 520/1053] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:49:21 2022] DELETE /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:49:21.914212 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:21.914827 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: bc849ee7-f7a6-479e-823a-928a7a5c22aa] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:21.920775 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:21.921267 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:21.921711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:21.922927 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:21.923392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:21.923821 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:21.937153 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] HTTP exception thrown: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Request method failure captured: Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa HTTP/1.1 Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKZJT5_KBwniMpNChZlu6CGRNF2hhZLg2Ormg3kaO5WXcYmjJXrI7VUMclf9bLxvWD4lcCF-Nu4gL27OB6fiMYb5DrXnLw4vcLwJsCUJYkPQyLamDxGAiyAmSrt5SECCwe65w1uh5y0nLV_zobWVMFl_BJ6XZ4vmmSaj1dYBy7cNkI Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:49:21.939348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97dc90210f5845e98a6bdb51aaef3518", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 5cbfcfbe01834b9ab9179bc032db813e Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.940885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'bc849ee7-f7a6-479e-823a-928a7a5c22aa'} Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:49:21.941742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. Aug 23 16:49:21.943223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:21.944682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Returning 404 to user: Instance bc849ee7-f7a6-479e-823a-928a7a5c22aa could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:49:21.944682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f9950832-cf7f-482a-9c7c-4319c58794fb tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa" status: 404 len: 111 microversion: 2.1 time: 0.030425 Aug 23 16:49:21.944682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 534/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:49:21 2022] GET /compute/v2.1/servers/bc849ee7-f7a6-479e-823a-928a7a5c22aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 16:49:22.716568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:22.717182 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:22.723896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:22.724418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:22.724857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:22.728547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:22.728547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:22.728547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:22.747789 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:22.862172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:22.870273 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:22.871776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:22.872983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ea97d221-e4ba-40b0-8d06-819a27543364 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1743 microversion: 2.20 time: 0.160331 Aug 23 16:49:22.873535 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 521/1055] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:22 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:23.265919 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:23.266442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:23.272876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:23.273382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:23.273831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:23.274529 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:23.274995 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:23.275429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:23.288943 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] HTTP exception thrown: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Request method failure captured: Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: DELETE /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f HTTP/1.1 Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKZJT5_KBwniMpNChZlu6CGRNF2hhZLg2Ormg3kaO5WXcYmjJXrI7VUMclf9bLxvWD4lcCF-Nu4gL27OB6fiMYb5DrXnLw4vcLwJsCUJYkPQyLamDxGAiyAmSrt5SECCwe65w1uh5y0nLV_zobWVMFl_BJ6XZ4vmmSaj1dYBy7cNkI Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:49:23.290487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97dc90210f5845e98a6bdb51aaef3518", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 5cbfcfbe01834b9ab9179bc032db813e Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.292043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'abfc7760-8432-47e6-b2a3-b4052a52201f'} Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:49:23.292938 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.294357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.295721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Returning 404 to user: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:49:23.295721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-29386ee4-bde6-490a-b8f5-2ad4e916c1bf tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "DELETE /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 404 len: 111 microversion: 2.1 time: 0.029900 Aug 23 16:49:23.295721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 535/1056] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:49:23 2022] DELETE /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:49:23.301314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:23.302033 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] [instance: abfc7760-8432-47e6-b2a3-b4052a52201f] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:23.308795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:23.309277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:23.309710 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:23.310402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:23.310847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:23.311264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:23.325075 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] HTTP exception thrown: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Request method failure captured: Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f HTTP/1.1 Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKZJT5_KBwniMpNChZlu6CGRNF2hhZLg2Ormg3kaO5WXcYmjJXrI7VUMclf9bLxvWD4lcCF-Nu4gL27OB6fiMYb5DrXnLw4vcLwJsCUJYkPQyLamDxGAiyAmSrt5SECCwe65w1uh5y0nLV_zobWVMFl_BJ6XZ4vmmSaj1dYBy7cNkI Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:49:23.326595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97dc90210f5845e98a6bdb51aaef3518", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97dc90210f5845e98a6bdb51aaef3518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 97dc90210f5845e98a6bdb51aaef3518 Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeTestJSON-662806723 Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 5cbfcfbe01834b9ab9179bc032db813e Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeTestJSON-662806723-project Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.328381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': 'abfc7760-8432-47e6-b2a3-b4052a52201f'} Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:49:23.329276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. Aug 23 16:49:23.330713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:49:23.332000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] Returning 404 to user: Instance abfc7760-8432-47e6-b2a3-b4052a52201f could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:49:23.332000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5bb03f5d-bc06-44bb-acf7-e894ccec843a tempest-AttachVolumeTestJSON-662806723 tempest-AttachVolumeTestJSON-662806723-project] 10.222.0.52 "GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f" status: 404 len: 111 microversion: 2.1 time: 0.031452 Aug 23 16:49:23.332000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 522/1057] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:49:23 2022] GET /compute/v2.1/servers/abfc7760-8432-47e6-b2a3-b4052a52201f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 16:49:23.899123 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:23.899946 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:23.906708 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:23.907271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:23.907778 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:23.908581 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:23.909224 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:23.909651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:24.053911 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:24.062317 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:24.063853 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:24.065063 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d062455e-42f0-4b60-bcbe-d9e105b6e87f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1743 microversion: 2.20 time: 0.169927 Aug 23 16:49:24.065615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 536/1058] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:23 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:25.088974 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:25.089585 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:25.097242 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:25.097778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:25.098235 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:25.099059 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:25.099372 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:25.099790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:25.243418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:25.247226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:25.248752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:25.249983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a7a090ba-9d44-4fed-a3db-9e39ea49a6ee tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1743 microversion: 2.20 time: 0.165639 Aug 23 16:49:25.250584 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 523/1059] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:25 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:26.015376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-68f0f3d6-3b72-4913-84d0-03661ef3bb7b req-2a83a5d3-bb4b-4a82-bd68-42ce54a5fa38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b213d8-efff-4b0b-b552-f0df17286d89", "name": "network-vif-plugged", "status": "completed", "tag": "bac680e8-6e99-4eba-867d-d2286bd579d0"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:49:26.026310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-68f0f3d6-3b72-4913-84d0-03661ef3bb7b req-2a83a5d3-bb4b-4a82-bd68-42ce54a5fa38 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:26.026858 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-68f0f3d6-3b72-4913-84d0-03661ef3bb7b req-2a83a5d3-bb4b-4a82-bd68-42ce54a5fa38 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:26.027337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-68f0f3d6-3b72-4913-84d0-03661ef3bb7b req-2a83a5d3-bb4b-4a82-bd68-42ce54a5fa38 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:26.039059 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-68f0f3d6-3b72-4913-84d0-03661ef3bb7b req-2a83a5d3-bb4b-4a82-bd68-42ce54a5fa38 service nova] Creating event network-vif-plugged:bac680e8-6e99-4eba-867d-d2286bd579d0 for instance 91b213d8-efff-4b0b-b552-f0df17286d89 on hv-cinder-85032 Aug 23 16:49:26.045273 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-68f0f3d6-3b72-4913-84d0-03661ef3bb7b req-2a83a5d3-bb4b-4a82-bd68-42ce54a5fa38 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 Aug 23 16:49:26.045859 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 537/1060] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:49:26.276689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:26.276689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:26.282436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:26.283011 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:26.283528 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:26.284280 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:26.284743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:26.285172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:26.464519 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:26.473625 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:26.475417 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:26.478912 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1811726f-a12c-48b1-8fd6-7c5cd54b7581 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1743 microversion: 2.20 time: 0.209245 Aug 23 16:49:26.479782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 524/1061] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:26 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1743 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:27.503592 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:27.504339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:27.511285 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:27.511777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:27.512257 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:27.512973 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:27.513795 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:27.513908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:27.679151 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:27.688123 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:27.689652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:27.690832 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-37deb427-c77b-4a16-81d3-8f621f9175df tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1743 microversion: 2.20 time: 0.192039 Aug 23 16:49:27.691620 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 538/1062] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:27 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:28.713764 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:28.714965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:28.722240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:28.722730 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:28.723157 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:28.724013 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:28.724527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:28.724952 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:28.871302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:28.881793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:28.883455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:28.885194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0400c143-9c80-49e0-964d-45c63ba7081c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.175033 Aug 23 16:49:28.885826 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 525/1063] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:28 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:29.916373 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:29.917213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:29.930667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=42 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:29.938800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:29.939412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:29.939935 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:29.940752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:29.941269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:29.941860 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:30.146208 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:30.157599 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:30.159455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:30.160788 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a2306102-733d-40c8-b05f-408cd87c301c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.249835 Aug 23 16:49:30.176622 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 539/1064] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:29 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:31.185526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:31.186349 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:31.205393 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:31.209233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:31.209233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:31.209233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:31.209233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:31.209602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:31.409200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:31.418799 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:31.420614 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:31.422201 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d663ef3d-b6b2-499d-ba4c-c3061f026fa1 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.241293 Aug 23 16:49:31.422957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 526/1065] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:31 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:32.447348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:32.447945 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:32.457386 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:32.457884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:32.458327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:32.459056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:32.459523 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:32.459951 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:32.620301 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:32.629927 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:32.631348 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:32.633058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-355e98d0-5e63-4610-b4db-e2f88210a89c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.189322 Aug 23 16:49:32.634069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 540/1066] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:32 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:33.657895 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:33.659550 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:33.668097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:33.669294 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:33.669977 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:33.670913 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:33.672181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:33.672719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:33.838527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:33.848760 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:33.850631 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:33.851923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-faa4929b-16bf-4671-bb78-5e3c9ce9cd7c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.198517 Aug 23 16:49:33.852634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 527/1067] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:33 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:34.877497 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:34.879356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:34.888867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:34.889597 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:34.890650 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:34.891463 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:34.892158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:34.892915 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:35.039585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:35.051517 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:35.053158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:35.054341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3a5818db-807d-44e9-8105-1ffe072101fe tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.181986 Aug 23 16:49:35.064231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 541/1068] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:34 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:36.078600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:36.079147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:36.086068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:36.086656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:36.087191 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:36.088036 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:36.088575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:36.089061 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:36.228846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:36.238947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:36.240483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:36.241686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-40db6c11-08fd-4f61-b0a2-d5ce810efd26 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.167285 Aug 23 16:49:36.242240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 528/1069] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:36 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:49:37.266589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:37.268003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:37.275157 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:37.280038 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:37.280038 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:37.280038 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:37.280038 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:37.280414 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:37.449519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:37.459584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:37.461385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:37.462973 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7663653b-fc2b-47b0-ba61-4fe2411d8903 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.201275 Aug 23 16:49:37.464251 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 542/1070] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:37 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:38.486433 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:38.487139 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:38.489915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:38.496925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:38.497920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:38.498532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:38.499247 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:38.500026 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:38.501174 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:38.701187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:38.710594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:38.712128 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:38.713588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-74115333-7c11-413d-9f2c-f6194721a987 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.231613 Aug 23 16:49:38.714160 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 529/1071] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:38 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:39.740048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:39.740697 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:39.747401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:39.747895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:39.748379 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:39.749089 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:39.750192 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:39.750727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:39.888114 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:39.896407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:39.897889 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:39.899094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-42bc0298-ec93-47b5-bef4-ae190cf06912 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.163305 Aug 23 16:49:39.899636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 543/1072] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:39 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:40.923166 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:40.924602 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:40.934867 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:40.935656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:40.936310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:40.942107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:40.942107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:40.942107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:41.081000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:41.089368 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:41.090914 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:41.092185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-e53add8e-8294-44c5-bfc9-ae3b01faccfa tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.174435 Aug 23 16:49:41.092738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 530/1073] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:40 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:42.116543 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:42.117186 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:42.123761 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:42.124285 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:42.124732 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:42.125484 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:42.125942 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:42.126366 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:42.254525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:42.263131 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:42.264684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:42.266383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2c590319-decc-4a8b-b91a-3ea298e24b7d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1738 microversion: 2.20 time: 0.153893 Aug 23 16:49:42.266947 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 544/1074] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:42 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:43.289069 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:43.289784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:43.296940 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:43.297527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:43.298032 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:43.298842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:43.299298 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:43.299723 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:43.432992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:43.441030 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:43.442507 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:43.443652 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-78c0c80b-4cfd-4414-8bc3-e0cf125c27d6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1720 microversion: 2.20 time: 0.158547 Aug 23 16:49:43.444218 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 531/1075] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:43 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:44.466785 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:44.467956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:44.474293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:44.474782 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:44.475211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:44.475906 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:44.476385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:44.476818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:44.614610 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:44.625519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:44.627049 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:44.628710 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-53135cda-7897-43bd-9c04-b983d32d1d29 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1720 microversion: 2.20 time: 0.165349 Aug 23 16:49:44.628852 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 545/1076] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:44 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:45.652089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:45.652870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:45.659487 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:45.659971 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:45.660433 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:45.661151 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:45.661604 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:45.662028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:45.807300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:45.816551 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:45.818073 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:45.819283 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8828f15a-9147-4734-bf09-c834c2471fad tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1723 microversion: 2.20 time: 0.171906 Aug 23 16:49:45.819840 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 532/1077] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:45 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:45.848962 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2d60fe83-2e85-4d2b-b7de-cffe185ffeab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc834154-d9db-4fb1-a6e8-0ac28088b9eb"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:49:45.851359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2d60fe83-2e85-4d2b-b7de-cffe185ffeab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:45.858008 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d60fe83-2e85-4d2b-b7de-cffe185ffeab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:45.859041 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d60fe83-2e85-4d2b-b7de-cffe185ffeab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:45.859482 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d60fe83-2e85-4d2b-b7de-cffe185ffeab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:45.860200 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d60fe83-2e85-4d2b-b7de-cffe185ffeab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:45.860844 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d60fe83-2e85-4d2b-b7de-cffe185ffeab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:45.861276 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2d60fe83-2e85-4d2b-b7de-cffe185ffeab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:46.101713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-c9af4dad-5d14-4a0c-8997-ad2b3256680b req-6d06e465-0d6b-4d09-882d-ecfc5a824b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b213d8-efff-4b0b-b552-f0df17286d89", "name": "network-vif-unplugged", "status": "completed", "tag": "bac680e8-6e99-4eba-867d-d2286bd579d0"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:49:46.112024 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-c9af4dad-5d14-4a0c-8997-ad2b3256680b req-6d06e465-0d6b-4d09-882d-ecfc5a824b35 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:46.112532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-c9af4dad-5d14-4a0c-8997-ad2b3256680b req-6d06e465-0d6b-4d09-882d-ecfc5a824b35 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:46.113000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-c9af4dad-5d14-4a0c-8997-ad2b3256680b req-6d06e465-0d6b-4d09-882d-ecfc5a824b35 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:46.124039 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.compute.server_external_events [req-c9af4dad-5d14-4a0c-8997-ad2b3256680b req-6d06e465-0d6b-4d09-882d-ecfc5a824b35 service nova] Unable to find a host for instance 91b213d8-efff-4b0b-b552-f0df17286d89. Dropping event network-vif-unplugged {{(pid=133199) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 16:49:46.124943 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-c9af4dad-5d14-4a0c-8997-ad2b3256680b req-6d06e465-0d6b-4d09-882d-ecfc5a824b35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027178 Aug 23 16:49:46.125526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 533/1078] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 23 16:49:46.986185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2d60fe83-2e85-4d2b-b7de-cffe185ffeab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.141575 Aug 23 16:49:46.986876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 546/1079] 10.222.0.52 () {62 vars in 1364 bytes} [Tue Aug 23 16:49:45 2022] POST /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/os-volume_attachments => generated 188 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 16:49:47.117258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-91551dbd-453d-42e3-bbdd-d10aa4ee79ac tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:47.117778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-91551dbd-453d-42e3-bbdd-d10aa4ee79ac tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:47.124656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91551dbd-453d-42e3-bbdd-d10aa4ee79ac tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:47.125132 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91551dbd-453d-42e3-bbdd-d10aa4ee79ac tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:47.125578 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91551dbd-453d-42e3-bbdd-d10aa4ee79ac tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:47.126342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91551dbd-453d-42e3-bbdd-d10aa4ee79ac tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:47.126697 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91551dbd-453d-42e3-bbdd-d10aa4ee79ac tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:47.127110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-91551dbd-453d-42e3-bbdd-d10aa4ee79ac tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:47.917603 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-91551dbd-453d-42e3-bbdd-d10aa4ee79ac tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/os-volume_attachments/bc834154-d9db-4fb1-a6e8-0ac28088b9eb" status: 202 len: 0 microversion: 2.20 time: 0.804257 Aug 23 16:49:47.918133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 534/1080] 10.222.0.52 () {60 vars in 1457 bytes} [Tue Aug 23 16:49:47 2022] DELETE /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/os-volume_attachments/bc834154-d9db-4fb1-a6e8-0ac28088b9eb => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:49:47.978068 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:49:47.978665 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:47.986441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:47.987076 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:47.987357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:47.988053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:47.988535 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:47.988962 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:48.031513 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133198) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 16:49:48.394752 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8e548f2e-c199-4bd7-9917-bc5439e8bb88 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "POST /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/action" status: 202 len: 0 microversion: 2.20 time: 0.420532 Aug 23 16:49:48.395636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 547/1081] 10.222.0.52 () {62 vars in 1319 bytes} [Tue Aug 23 16:49:47 2022] POST /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:49:48.404444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:48.405110 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:48.412348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:48.413014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:48.413624 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:48.414405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:48.414872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:48.415314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:48.552818 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:48.567059 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:48.568581 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:48.569757 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-eab214d0-2404-42a8-b0ac-4a212e415a21 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1671 microversion: 2.20 time: 0.169738 Aug 23 16:49:48.571079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 535/1082] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:48 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:49.598005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:49.598620 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:49.605254 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:49.605875 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:49.606328 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:49.607097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:49.607489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:49.608240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:49.612465 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:49.828085 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:49.837236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:49.839038 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:49.840374 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f3cdcc40-c6d2-4753-b660-3c4e010d6088 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1671 microversion: 2.20 time: 0.251181 Aug 23 16:49:49.841111 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 548/1083] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:49 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1671 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:50.870972 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:50.870972 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:50.872438 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:50.872920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:50.873348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:50.874526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:50.874969 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:50.875432 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:51.007027 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:51.016658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:51.018172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:51.019441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8c84303a-d984-434c-9330-1e4cb0bb17ff tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.158364 Aug 23 16:49:51.020007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 536/1084] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:50 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:51.850033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f7bad7b7-03ab-433f-b4ce-357e249105a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:51.850557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f7bad7b7-03ab-433f-b4ce-357e249105a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:51.857125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f7bad7b7-03ab-433f-b4ce-357e249105a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:51.857613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f7bad7b7-03ab-433f-b4ce-357e249105a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:51.858345 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f7bad7b7-03ab-433f-b4ce-357e249105a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:51.859044 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f7bad7b7-03ab-433f-b4ce-357e249105a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:51.859491 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f7bad7b7-03ab-433f-b4ce-357e249105a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:51.859919 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f7bad7b7-03ab-433f-b4ce-357e249105a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:51.883001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f7bad7b7-03ab-433f-b4ce-357e249105a1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/ips" status: 200 len: 148 microversion: 2.1 time: 0.037143 Aug 23 16:49:51.883574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 549/1085] 10.222.0.52 () {58 vars in 1248 bytes} [Tue Aug 23 16:49:51 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:49:52.042356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:52.042970 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:52.136380 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:52.136998 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:52.137441 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:52.138155 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:52.138668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:52.139100 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:52.142607 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:49:52.270294 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:52.278396 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:52.279908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:52.281230 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2028009a-7e65-4a93-94d8-ce020fb10759 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.242735 Aug 23 16:49:52.287035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 537/1086] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:52 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:53.304071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:53.304716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:53.311342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:53.311871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:53.312353 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:53.313054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:53.313519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:53.313952 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:53.442584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:53.451220 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:53.453269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:53.454437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a7a9b93c-d89d-4e28-ad6a-47f9d6136923 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.154299 Aug 23 16:49:53.455099 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 550/1087] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:53 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:54.478278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:54.478938 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:54.486537 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:54.487021 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:54.487455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:54.488152 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:54.488633 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:54.489083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:54.624242 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:54.632488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:54.633992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:54.635197 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b4256397-8dae-4ba7-8dca-a2056c9b2d62 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.160987 Aug 23 16:49:54.635759 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 538/1088] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:54 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:55.659569 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:55.661567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:55.672536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:55.673623 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:55.674478 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:55.675866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:55.677025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:55.677885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:55.838438 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:55.850222 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:55.852096 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:55.853543 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ec74382f-a97a-437d-8eb3-0fb0eedc7716 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.199539 Aug 23 16:49:55.856949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 551/1089] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:55 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:56.661571 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bb0125f0-adee-4d06-98f8-ad5d0458b6ad tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4c161d9-6fec-4352-9466-a08f5e633846"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:49:56.670658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bb0125f0-adee-4d06-98f8-ad5d0458b6ad tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:56.681877 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb0125f0-adee-4d06-98f8-ad5d0458b6ad tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:56.682375 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb0125f0-adee-4d06-98f8-ad5d0458b6ad tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:56.682872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb0125f0-adee-4d06-98f8-ad5d0458b6ad tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:56.683528 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb0125f0-adee-4d06-98f8-ad5d0458b6ad tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:56.683982 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb0125f0-adee-4d06-98f8-ad5d0458b6ad tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:56.684470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bb0125f0-adee-4d06-98f8-ad5d0458b6ad tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:56.878276 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:56.878876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:56.886329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:56.889780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:56.889780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:56.889780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:56.889780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:56.890285 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:57.034052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:57.047014 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:57.048896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:57.050098 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-85caa938-6099-40ce-bf63-9ef2eb6bb965 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.176045 Aug 23 16:49:57.050998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 552/1090] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:56 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:49:58.077043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:58.078841 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:58.084024 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:58.084559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:58.084997 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:58.085684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:58.086136 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:58.086606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:58.240358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:58.250385 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:58.251935 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:58.253154 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fcdbe340-257e-4000-a432-11d9ad1b972d tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.180404 Aug 23 16:49:58.253713 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 553/1091] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:58 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:49:59.278307 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:49:59.279343 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:49:59.287043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:59.287677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:59.288136 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:59.288936 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:49:59.289472 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:49:59.290012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:49:59.437600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:59.447413 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:59.448948 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:49:59.450318 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4277c640-75c9-4ac8-8362-43f8e34749e6 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.176374 Aug 23 16:49:59.450873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 554/1092] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:49:59 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:50:00.473902 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:00.474866 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:00.478825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:50:00.483015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:00.483782 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:00.484467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:00.485418 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:00.486119 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:00.486657 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:00.656422 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:00.665775 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:00.667701 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:00.670813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8cf60026-c91c-4ec8-887d-098dc8b95832 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.200867 Aug 23 16:50:00.671382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 555/1093] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:00 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:50:01.695086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:01.695847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:01.702439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:01.702931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:01.703363 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:01.704065 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:01.705320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:01.705320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:01.869773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:01.879845 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:01.881785 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:01.884420 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c5294f92-30df-4382-90c7-edad8eacd491 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.192204 Aug 23 16:50:01.884420 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 556/1094] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:01 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:50:02.906445 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:02.908044 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:02.915566 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:02.916442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:02.917118 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:02.918104 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:02.918910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:02.919541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:03.330873 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:03.339771 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:03.341223 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:03.342406 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1a5d8783-5fe4-4283-a275-4a4983905d72 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.440502 Aug 23 16:50:03.354627 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 557/1095] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:02 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:50:04.365748 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:04.366350 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:04.372600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:04.373078 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:04.373512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:04.374205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:04.374653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:04.375086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:04.520879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:04.529838 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:04.531342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:04.533161 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1e7d204e-fd15-4a01-8d50-1aad0e56d750 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.171405 Aug 23 16:50:04.533719 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 558/1096] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:04 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:50:05.556596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:05.557256 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:05.564594 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:05.565061 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:05.565511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:05.566252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:05.566713 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:05.567145 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:05.709335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:05.717572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:05.719083 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:05.720268 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4ca2b182-0e94-4f6b-b177-5024d474ef1b tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.168297 Aug 23 16:50:05.720831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 559/1097] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:05 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:50:06.675060 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=21 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:50:06.743581 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:06.744222 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:06.751291 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:06.751831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:06.752329 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:06.753066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:06.753524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:06.753962 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:06.762372 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=17 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:50:06.886658 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:06.896291 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:06.897800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:06.898982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0d59b9b8-a7e6-4675-b498-7893dd74ee97 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.159346 Aug 23 16:50:06.899539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 560/1098] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:06 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:50:07.921382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:07.922054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:07.929218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:07.929697 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:07.930130 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:07.930827 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:07.931280 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:07.931703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:08.070787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:08.079187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:08.080964 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:08.082138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2576cfd7-3020-4bb2-813c-d83ca39c2474 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.164838 Aug 23 16:50:08.082702 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 561/1099] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:07 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:50:09.106669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:09.107390 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:09.114534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:09.115023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:09.115722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:09.116430 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:09.116901 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:09.117357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:09.256145 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:09.264672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:09.266231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:09.267428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-31cc56e9-1544-4949-897c-9fb55a915a05 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.164745 Aug 23 16:50:09.267982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 562/1100] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:09 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:50:10.290904 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:10.291530 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:10.298048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:10.298541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:10.298988 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:10.299688 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:10.300158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:10.300612 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:10.445978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:10.454503 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:10.455999 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:10.457199 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-91c856bd-a7e9-4cee-87dd-333ececf5d35 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.170309 Aug 23 16:50:10.457802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 563/1101] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:10 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:50:10.720977 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bb0125f0-adee-4d06-98f8-ad5d0458b6ad tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "POST /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.063073 Aug 23 16:50:10.721856 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 539/1102] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:49:56 2022] POST /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments => generated 194 bytes in 14065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:50:11.480189 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:11.480797 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:11.488117 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:11.488631 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:11.489077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:11.489781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:11.490271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:11.490707 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:11.634763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:11.643744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:11.649749 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:11.649749 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-364e4e05-3a99-4e82-9b33-916a9c8340a4 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.170193 Aug 23 16:50:11.649749 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 564/1103] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:11 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:50:12.240830 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-39bee3e2-382f-436f-92ef-34adc260afc3 req-6ef15348-094f-4605-9020-83a33ceddf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b213d8-efff-4b0b-b552-f0df17286d89", "name": "network-vif-plugged", "status": "completed", "tag": "bac680e8-6e99-4eba-867d-d2286bd579d0"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:50:12.251958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-39bee3e2-382f-436f-92ef-34adc260afc3 req-6ef15348-094f-4605-9020-83a33ceddf8d service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:12.252462 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-39bee3e2-382f-436f-92ef-34adc260afc3 req-6ef15348-094f-4605-9020-83a33ceddf8d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:12.252883 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-39bee3e2-382f-436f-92ef-34adc260afc3 req-6ef15348-094f-4605-9020-83a33ceddf8d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:12.262964 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-39bee3e2-382f-436f-92ef-34adc260afc3 req-6ef15348-094f-4605-9020-83a33ceddf8d service nova] Creating event network-vif-plugged:bac680e8-6e99-4eba-867d-d2286bd579d0 for instance 91b213d8-efff-4b0b-b552-f0df17286d89 on hv-cinder-85032 Aug 23 16:50:12.267916 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-39bee3e2-382f-436f-92ef-34adc260afc3 req-6ef15348-094f-4605-9020-83a33ceddf8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033791 Aug 23 16:50:12.268886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 540/1104] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:50:12.670296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:12.670940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:12.678469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:12.678992 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:12.679619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:12.680560 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:12.681149 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:12.681585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:12.686293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=100 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:50:12.822667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:12.831771 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:12.833314 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:12.834501 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-94b8fbd9-b8f9-4a85-ab65-f7e28a6ca250 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.168666 Aug 23 16:50:12.835060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 565/1105] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:12 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:50:13.859225 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:13.859923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:13.866990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:13.867469 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:13.867903 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:13.868612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:13.869064 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:13.869487 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:14.002833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:14.011045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:14.012689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:14.013880 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8e029e67-238e-4cea-a6ce-cdceb58da317 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.159723 Aug 23 16:50:14.014455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 541/1106] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:13 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:50:15.036396 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:15.037014 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:15.043867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:15.044428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:15.044887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:15.045596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:15.046054 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:15.046490 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:15.176589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:15.185269 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:15.186705 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:15.188339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fa21aad3-c639-4a6e-904b-4b112191bf4f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.155497 Aug 23 16:50:15.189035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 566/1107] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:15 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:50:16.211778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:16.212650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:16.219394 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:16.219880 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:16.220342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:16.221552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:16.222006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:16.222426 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:16.358300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:16.367062 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:16.368743 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:16.369909 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c5d8562a-bd73-4625-9e5e-c9abcd6319db tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1729 microversion: 2.20 time: 0.163027 Aug 23 16:50:16.370474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 542/1108] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:16 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:50:17.392648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:17.393188 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:17.399567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:17.400056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:17.400554 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:17.401251 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:17.401711 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:17.402144 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:17.533046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:17.542170 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:17.547605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:17.547605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-771e96d5-135a-43eb-8e59-ca20b0524dcf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1716 microversion: 2.20 time: 0.156392 Aug 23 16:50:17.547605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 567/1109] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:50:17 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:50:19.401597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:19.402098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:19.408506 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:19.408980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:19.411260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:19.411260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:19.411260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:19.411260 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:19.489585 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lazy-loading 'services' on Instance uuid 8a9d9c40-70f0-47d7-912c-d3ded849b68c {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:50:19.728416 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-342e8cb3-0d7e-4f9b-85be-145fa4589444 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments/f4c161d9-6fec-4352-9466-a08f5e633846" status: 202 len: 0 microversion: 2.1 time: 0.330488 Aug 23 16:50:19.729010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 543/1110] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:50:19 2022] DELETE /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments/f4c161d9-6fec-4352-9466-a08f5e633846 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:50:19.738949 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b2b4634e-eb5a-4af2-805c-724888245f81 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:19.741461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b2b4634e-eb5a-4af2-805c-724888245f81 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:19.748187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b2b4634e-eb5a-4af2-805c-724888245f81 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:19.748751 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b2b4634e-eb5a-4af2-805c-724888245f81 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:19.749220 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b2b4634e-eb5a-4af2-805c-724888245f81 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:19.749908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b2b4634e-eb5a-4af2-805c-724888245f81 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:19.750383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b2b4634e-eb5a-4af2-805c-724888245f81 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:19.750806 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b2b4634e-eb5a-4af2-805c-724888245f81 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:19.781756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b2b4634e-eb5a-4af2-805c-724888245f81 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 Aug 23 16:50:19.784436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 568/1111] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:50:19 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:50:20.796512 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5d15cd56-2c65-4b5b-8dd4-a1e82a6e82d5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:20.798947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5d15cd56-2c65-4b5b-8dd4-a1e82a6e82d5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:20.805354 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d15cd56-2c65-4b5b-8dd4-a1e82a6e82d5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:20.805844 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d15cd56-2c65-4b5b-8dd4-a1e82a6e82d5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:20.806618 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d15cd56-2c65-4b5b-8dd4-a1e82a6e82d5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:20.807325 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d15cd56-2c65-4b5b-8dd4-a1e82a6e82d5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:20.807780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d15cd56-2c65-4b5b-8dd4-a1e82a6e82d5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:20.808233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5d15cd56-2c65-4b5b-8dd4-a1e82a6e82d5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:20.840643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5d15cd56-2c65-4b5b-8dd4-a1e82a6e82d5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049166 Aug 23 16:50:20.841224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 544/1112] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:50:20 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:50:21.853567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dcead2e5-4361-4291-839b-c524cd018ef1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:21.855818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-dcead2e5-4361-4291-839b-c524cd018ef1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:21.862524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dcead2e5-4361-4291-839b-c524cd018ef1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:21.863018 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dcead2e5-4361-4291-839b-c524cd018ef1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:21.863461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dcead2e5-4361-4291-839b-c524cd018ef1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:21.864194 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dcead2e5-4361-4291-839b-c524cd018ef1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:21.864653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dcead2e5-4361-4291-839b-c524cd018ef1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:21.865089 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dcead2e5-4361-4291-839b-c524cd018ef1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:21.894794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dcead2e5-4361-4291-839b-c524cd018ef1 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045758 Aug 23 16:50:21.895345 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 569/1113] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:50:21 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 16:50:21.955745 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:21.956403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:21.962617 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:21.963099 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:21.963531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:21.964241 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:21.964692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:21.965112 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:21.990418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:50:22.333387 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-aa82ae96-87f0-4e91-ac37-f305b2a20674 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 204 len: 0 microversion: 2.1 time: 0.381207 Aug 23 16:50:22.333982 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 545/1114] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:50:21 2022] DELETE /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:50:22.342885 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:22.343521 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:22.349618 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:22.350121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:22.350545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:22.351243 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:22.351736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:22.352761 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:22.485682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:22.493622 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-33bc6f61-6e10-4065-b3d0-d5cef12b6bf3 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1681 microversion: 2.1 time: 0.154776 Aug 23 16:50:22.494196 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 570/1115] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:50:22 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:50:23.515486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:23.516254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:23.522915 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:23.523413 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:23.523842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:23.524634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:23.525105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:23.525528 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:23.658447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:23.666776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4c964738-2932-44af-aadd-88772ddae431 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1681 microversion: 2.1 time: 0.155607 Aug 23 16:50:23.667341 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 546/1116] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:50:23 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:50:24.687427 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:24.688045 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:24.694579 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:24.695066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:24.695503 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:24.696247 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:24.696705 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:24.697134 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:24.910285 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:24.918612 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e2c5ab23-e734-4cd5-ae0d-84e3178a98ff tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1681 microversion: 2.1 time: 0.235106 Aug 23 16:50:24.919187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 571/1117] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:50:24 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:50:25.587216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-6ac4ca5c-b26b-4338-b328-2d96a6bddffb req-c1ea1bf1-052f-4ee6-bbee-916cd4b15884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9d9c40-70f0-47d7-912c-d3ded849b68c", "name": "network-vif-deleted", "tag": "298636c9-04a5-4ea8-b191-a4ffc865d9fc"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:50:25.597296 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-6ac4ca5c-b26b-4338-b328-2d96a6bddffb req-c1ea1bf1-052f-4ee6-bbee-916cd4b15884 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:25.597756 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-6ac4ca5c-b26b-4338-b328-2d96a6bddffb req-c1ea1bf1-052f-4ee6-bbee-916cd4b15884 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:25.598176 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-6ac4ca5c-b26b-4338-b328-2d96a6bddffb req-c1ea1bf1-052f-4ee6-bbee-916cd4b15884 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:25.611636 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-6ac4ca5c-b26b-4338-b328-2d96a6bddffb req-c1ea1bf1-052f-4ee6-bbee-916cd4b15884 service nova] Creating event network-vif-deleted:298636c9-04a5-4ea8-b191-a4ffc865d9fc for instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c on hv-cinder-85032 Aug 23 16:50:25.616202 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-6ac4ca5c-b26b-4338-b328-2d96a6bddffb req-c1ea1bf1-052f-4ee6-bbee-916cd4b15884 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 Aug 23 16:50:25.616682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 547/1118] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:50:25.940638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:25.941232 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:25.947300 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:25.947784 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:25.948248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:25.948941 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:25.949391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:25.949814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:26.015310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a642d26e91c8449296a7a6733221824f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b2175d3e8444292aac6cd003b0668d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:50:26.025171 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ad9f4ae1-9f9b-4725-9f7e-5108bb7f8706 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 200 len: 1327 microversion: 2.1 time: 0.088641 Aug 23 16:50:26.025868 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 572/1119] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:50:25 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 1327 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:50:27.051089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:27.051779 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:27.058405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:27.058886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:27.059316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:27.059997 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:27.060472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:27.060890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:27.074383 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c HTTP/1.1 Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:50:27.075983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:27.077446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '8a9d9c40-70f0-47d7-912c-d3ded849b68c'} Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:50:27.078284 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:27.079796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:27.081216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:50:27.081216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3fbfd5e8-5274-4b49-beb4-e7028deba6c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 404 len: 111 microversion: 2.1 time: 0.031030 Aug 23 16:50:27.081216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 548/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:50:27 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:50:27.086338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6993ae76-db7c-430c-8504-81f6c0a25903 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '.version_select at 0x7f67781e7550>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:27.181177 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6993ae76-db7c-430c-8504-81f6c0a25903 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006591027" status: 202 len: 0 microversion: 2.1 time: 0.097935 Aug 23 16:50:27.181767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 573/1121] 10.222.0.52 () {58 vars in 1221 bytes} [Tue Aug 23 16:50:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006591027 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:50:29.868344 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 16:50:29.868893 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 16:50:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 16:50:30.267974 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:30.268506 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:30.274979 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:30.275458 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:30.275898 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:30.276612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:30.277062 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:30.277483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:30.291467 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: DELETE /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c HTTP/1.1 Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:50:30.293028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.294601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '8a9d9c40-70f0-47d7-912c-d3ded849b68c'} Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:50:30.295665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.297167 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.298842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:50:30.298842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-544b7e22-6fed-4877-8d70-67274c5b3c55 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 404 len: 111 microversion: 2.1 time: 0.030262 Aug 23 16:50:30.298842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 549/1122] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:50:30 2022] DELETE /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:50:30.303636 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:30.304303 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 8a9d9c40-70f0-47d7-912c-d3ded849b68c] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:30.312086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:30.312615 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:30.313150 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:30.313855 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:30.314316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:30.314750 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:30.328292 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c HTTP/1.1 Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:50:30.329961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.331670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '8a9d9c40-70f0-47d7-912c-d3ded849b68c'} Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:50:30.332558 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. Aug 23 16:50:30.333847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:30.334994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance 8a9d9c40-70f0-47d7-912c-d3ded849b68c could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:50:30.334994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1a24a47e-cacc-4060-b454-4ba76dd84fbb tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c" status: 404 len: 111 microversion: 2.1 time: 0.032358 Aug 23 16:50:30.334994 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 574/1123] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:50:30 2022] GET /compute/v2.1/servers/8a9d9c40-70f0-47d7-912c-d3ded849b68c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:50:31.794512 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:31.795040 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:31.801678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:31.802172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:31.804210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:31.804210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:31.804210 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:31.804564 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:31.818563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: DELETE /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 HTTP/1.1 Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:50:31.820097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.821713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '35678a46-44f2-44f5-87d9-4af40d0b7d32'} Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:50:31.822775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.824071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.825431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:50:31.825431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6f965de0-030d-40bf-a8a3-c0cd39cb1831 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 404 len: 111 microversion: 2.1 time: 0.030936 Aug 23 16:50:31.825431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 550/1124] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:50:31 2022] DELETE /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:50:31.829914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:31.832944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 35678a46-44f2-44f5-87d9-4af40d0b7d32] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:31.832944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:50:31.837448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:31.838570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:31.839018 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:31.839716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:31.840194 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:31.840616 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:31.855496 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 HTTP/1.1 Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:50:31.857048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.863021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '35678a46-44f2-44f5-87d9-4af40d0b7d32'} Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:50:31.863793 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. Aug 23 16:50:31.865088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.866158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance 35678a46-44f2-44f5-87d9-4af40d0b7d32 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:50:31.866158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3bd452e1-7635-4050-87b7-6a698af1b612 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32" status: 404 len: 111 microversion: 2.1 time: 0.032565 Aug 23 16:50:31.866158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 575/1125] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:50:31 2022] GET /compute/v2.1/servers/35678a46-44f2-44f5-87d9-4af40d0b7d32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 16:50:31.867134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:31.867756 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:31.874187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:31.874655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:31.875083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:31.875758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:31.876217 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:31.876634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:31.890676 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: DELETE /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b HTTP/1.1 Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:50:31.892319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.893922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '7187ddca-2154-4ba6-be64-927f9e0c486b'} Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:50:31.894990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.896573 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.898278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:50:31.898278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b127b604-825c-44ce-8bbe-21f81b79ea1e tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 404 len: 111 microversion: 2.1 time: 0.030354 Aug 23 16:50:31.898278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 551/1126] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:50:31 2022] DELETE /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 16:50:31.902638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:31.903249 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: 7187ddca-2154-4ba6-be64-927f9e0c486b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:31.909672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:31.910148 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:31.910583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:31.911271 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:31.911718 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:31.912141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:31.927969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b HTTP/1.1 Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:50:31.929584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.931918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '7187ddca-2154-4ba6-be64-927f9e0c486b'} Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:50:31.933250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. Aug 23 16:50:31.934727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:31.936327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance 7187ddca-2154-4ba6-be64-927f9e0c486b could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:50:31.936327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-62cc787a-3c94-4098-a8f0-daa37a2d77a5 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b" status: 404 len: 111 microversion: 2.1 time: 0.033318 Aug 23 16:50:31.936327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 576/1127] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:50:31 2022] GET /compute/v2.1/servers/7187ddca-2154-4ba6-be64-927f9e0c486b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:50:33.294001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:33.294545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:33.301389 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:33.301898 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:33.302345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:33.303157 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:33.303559 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:33.304012 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:33.318125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: DELETE /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 HTTP/1.1 Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:50:33.319702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.321259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': 'e652ad27-aa55-41e5-ba8e-5110c204c128'} Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:50:33.322086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.323526 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.325084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:50:33.325084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-682715f3-696f-4d2f-979d-4d24a739c2c0 tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 404 len: 111 microversion: 2.1 time: 0.031570 Aug 23 16:50:33.325084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 552/1128] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:50:33 2022] DELETE /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:50:33.330098 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:50:33.330921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] [instance: e652ad27-aa55-41e5-ba8e-5110c204c128] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:50:33.337395 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:33.337897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:33.338320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:33.339022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:50:33.339489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:50:33.339905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:50:33.354899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] HTTP exception thrown: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Request method failure captured: Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 HTTP/1.1 Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQKSfsRT9S61Nhq3ZLCoj3HXZLO24E7pXNgGsVBPLhhXBWBoIQu__k6-56NU7A4YEPWyNotFI40FIv1ZLbXz_L8CRc-rTVgA3_qM313fp5MSwJkHkvWXygVp9JpjH1ZXk6M1xTYQIGpM18AJeiKnfCDZ7CDGCUr-AwIGMB1PZbgwIX8 Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:50:33.356546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3b2175d3e8444292aac6cd003b0668d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3b2175d3e8444292aac6cd003b0668d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 3b2175d3e8444292aac6cd003b0668d8 Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-498737334 Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: a642d26e91c8449296a7a6733221824f Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeNegativeTest-498737334-project Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.358391 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'e652ad27-aa55-41e5-ba8e-5110c204c128'} Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:50:33.359522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. Aug 23 16:50:33.360998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:50:33.362294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] Returning 404 to user: Instance e652ad27-aa55-41e5-ba8e-5110c204c128 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:50:33.362294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b775ffc8-8d31-4c65-b9b8-9ffbed88022a tempest-AttachVolumeNegativeTest-498737334 tempest-AttachVolumeNegativeTest-498737334-project] 10.222.0.52 "GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128" status: 404 len: 111 microversion: 2.1 time: 0.031999 Aug 23 16:50:33.362294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 577/1129] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:50:33 2022] GET /compute/v2.1/servers/e652ad27-aa55-41e5-ba8e-5110c204c128 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:51:01.099066 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:01.100157 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:01.303928 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a778ff2a-beec-4286-b8e2-6d1a2c1bca54 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Action: 'create', calling method: .version_select at 0x7f67785b9af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1743212429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7pLUPf/6lLHanacFKRkiq+G7dCFD+GP3GSeWvfaQIEHIMy3zw+tRd8WCQh1wS/04aNcZtpi9Qu/wJcvp1svocyfSgX1qzVdNbkAr7FssmlzHRxfcDKiC30swtYauG6rQ=="}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:51:01.321655 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-a778ff2a-beec-4286-b8e2-6d1a2c1bca54 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Getting quotas for project e40dd5c44be5454f9fbeefdd8ae7b45f. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:51:01.328777 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-a778ff2a-beec-4286-b8e2-6d1a2c1bca54 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Getting quotas for user 866f33b28b714010a9807cd5a716939a and project e40dd5c44be5454f9fbeefdd8ae7b45f. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:51:01.414622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a778ff2a-beec-4286-b8e2-6d1a2c1bca54 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.320308 Aug 23 16:51:01.415482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 553/1130] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:51:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:13.417872 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fbfd50df-342d-45e5-bc85-7c488b827ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:13.423010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fbfd50df-342d-45e5-bc85-7c488b827ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:13.423010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=5 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:13.423010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=55 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:13.427442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fbfd50df-342d-45e5-bc85-7c488b827ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:13.427928 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fbfd50df-342d-45e5-bc85-7c488b827ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:13.428440 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fbfd50df-342d-45e5-bc85-7c488b827ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:13.429170 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fbfd50df-342d-45e5-bc85-7c488b827ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:13.429630 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fbfd50df-342d-45e5-bc85-7c488b827ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:13.430066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fbfd50df-342d-45e5-bc85-7c488b827ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:13.462312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fbfd50df-342d-45e5-bc85-7c488b827ccc tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048539 Aug 23 16:51:13.462893 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 578/1131] 10.222.0.52 () {60 vars in 1343 bytes} [Tue Aug 23 16:51:13 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:13.527647 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:13.528342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:13.530963 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=4 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:13.537671 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:13.538159 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:13.538595 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:13.539291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:13.539745 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:13.540382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:13.566068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:51:13.938886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d5cc25b2-bcd8-4e42-85a3-48efeb92c0d3 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 204 len: 0 microversion: 2.20 time: 0.415869 Aug 23 16:51:13.939612 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 554/1132] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 23 16:51:13 2022] DELETE /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 16:51:13.948120 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:13.948846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:13.955609 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:13.956105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:13.956581 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:13.957291 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:13.957746 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:13.958177 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:14.094117 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:14.102573 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:14.104077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:14.105851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-71e62bae-d941-49b8-8305-18566ddd7da2 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.162057 Aug 23 16:51:14.106408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 579/1133] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:51:13 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 16:51:15.129713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:15.130493 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:15.140552 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:15.141048 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:15.141494 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:15.142257 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:15.142703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:15.143130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:15.276563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:15.284747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:15.286235 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:15.287388 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-43c74bfa-638c-48bc-86c8-d1354e0b6411 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1722 microversion: 2.20 time: 0.162269 Aug 23 16:51:15.287947 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 555/1134] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:51:15 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:51:16.310337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:16.310968 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:16.317993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:16.318476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:16.318914 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:16.319614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:16.320074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:16.320537 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:16.409351 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:16.423509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:16.423509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:16.423509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7e68c02b-ba9f-4ba1-8bf3-e023c3e7368f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1655 microversion: 2.20 time: 0.114952 Aug 23 16:51:16.423977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 580/1135] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:51:16 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:51:16.852727 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-ab69a3b0-cc21-4107-9425-3e9f74ed6d4c req-c16d3d96-f3aa-4130-b3dc-82bc8623cb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91b213d8-efff-4b0b-b552-f0df17286d89", "name": "network-vif-deleted", "tag": "bac680e8-6e99-4eba-867d-d2286bd579d0"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:51:16.865983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ab69a3b0-cc21-4107-9425-3e9f74ed6d4c req-c16d3d96-f3aa-4130-b3dc-82bc8623cb6d service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:16.866836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ab69a3b0-cc21-4107-9425-3e9f74ed6d4c req-c16d3d96-f3aa-4130-b3dc-82bc8623cb6d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:16.867473 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ab69a3b0-cc21-4107-9425-3e9f74ed6d4c req-c16d3d96-f3aa-4130-b3dc-82bc8623cb6d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:16.885929 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-ab69a3b0-cc21-4107-9425-3e9f74ed6d4c req-c16d3d96-f3aa-4130-b3dc-82bc8623cb6d service nova] Creating event network-vif-deleted:bac680e8-6e99-4eba-867d-d2286bd579d0 for instance 91b213d8-efff-4b0b-b552-f0df17286d89 on hv-cinder-85032 Aug 23 16:51:16.891541 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-ab69a3b0-cc21-4107-9425-3e9f74ed6d4c req-c16d3d96-f3aa-4130-b3dc-82bc8623cb6d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213705 Aug 23 16:51:16.895900 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 556/1136] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:17.444231 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:17.445451 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:17.458143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:17.458143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:17.458143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:17.458143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:17.458529 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:17.458529 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:17.490607 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:17.491082 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:17.492244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:17.492244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lazy-loading 'fault' on Instance uuid 91b213d8-efff-4b0b-b552-f0df17286d89 {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:51:17.534605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:17.543367 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:17.545055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ff570c1fa134bcebfd597ded5a95168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdf236fc9724490a26aeac2b680918b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:17.546336 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5c4277e1-a39b-4654-9780-3c2464ae340c tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 200 len: 1372 microversion: 2.20 time: 0.106137 Aug 23 16:51:17.552248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 581/1137] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:51:17 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 16:51:18.577778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:18.578771 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:18.585956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:18.586503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:18.587148 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:18.587951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:18.588529 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:18.589141 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:18.603569 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] HTTP exception thrown: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Request method failure captured: Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 HTTP/1.1 Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQMKtg-IuAzdOB2pLnbFp-5eAFrYAKiI_0sh0gH4o8WMpHEHi6kRpUDfJDoD9Xe8hUVnwRZATw4PoRaGr5DixCNw0qwy6kcBl7Wn1NuuKQiOJgtvpJNHoMmrbwCM8-n5uYKP8ezvD8LK6MDBy5JjV3efBltJn1pV5bbEkyW97F6osHU Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:51:18.605478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7bdf236fc9724490a26aeac2b680918b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 1ff570c1fa134bcebfd597ded5a95168 Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:18.607399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '91b213d8-efff-4b0b-b552-f0df17286d89'} Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:51:18.608626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:18.610173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:18.611544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Returning 404 to user: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:51:18.611544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5c199cad-c1f2-45c8-b885-9c61f07e28ba tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 404 len: 111 microversion: 2.20 time: 0.035776 Aug 23 16:51:18.611544 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 557/1138] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:51:18 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:51:18.616657 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-afb14dd0-dff5-42ab-9403-230d42ab1476 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '.version_select at 0x7f6778205c10>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:18.727854 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-afb14dd0-dff5-42ab-9403-230d42ab1476 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734466419" status: 204 len: 0 microversion: 2.20 time: 0.115077 Aug 23 16:51:18.728458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 582/1139] 10.222.0.52 () {60 vars in 1262 bytes} [Tue Aug 23 16:51:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734466419 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 16:51:20.749818 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:20.750302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:20.756853 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:20.757341 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:20.757780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:20.758471 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:20.758926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:20.759350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:20.772634 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] HTTP exception thrown: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Request method failure captured: Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: DELETE /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 HTTP/1.1 Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQMKtg-IuAzdOB2pLnbFp-5eAFrYAKiI_0sh0gH4o8WMpHEHi6kRpUDfJDoD9Xe8hUVnwRZATw4PoRaGr5DixCNw0qwy6kcBl7Wn1NuuKQiOJgtvpJNHoMmrbwCM8-n5uYKP8ezvD8LK6MDBy5JjV3efBltJn1pV5bbEkyW97F6osHU Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:51:20.779070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7bdf236fc9724490a26aeac2b680918b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 1ff570c1fa134bcebfd597ded5a95168 Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.780547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '91b213d8-efff-4b0b-b552-f0df17286d89'} Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:51:20.781489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.782984 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.784536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Returning 404 to user: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:51:20.784536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8d0d630e-6a30-4169-b999-617a54df26cf tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 404 len: 111 microversion: 2.20 time: 0.029639 Aug 23 16:51:20.784536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 558/1140] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 23 16:51:20 2022] DELETE /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:51:20.785882 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:20.786533 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 91b213d8-efff-4b0b-b552-f0df17286d89] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:20.794433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:20.794918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:20.795358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:20.796047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:20.796544 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:20.796975 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:20.809910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] HTTP exception thrown: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Request method failure captured: Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 HTTP/1.1 Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQMKtg-IuAzdOB2pLnbFp-5eAFrYAKiI_0sh0gH4o8WMpHEHi6kRpUDfJDoD9Xe8hUVnwRZATw4PoRaGr5DixCNw0qwy6kcBl7Wn1NuuKQiOJgtvpJNHoMmrbwCM8-n5uYKP8ezvD8LK6MDBy5JjV3efBltJn1pV5bbEkyW97F6osHU Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:51:20.811437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7bdf236fc9724490a26aeac2b680918b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 1ff570c1fa134bcebfd597ded5a95168 Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.813086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '91b213d8-efff-4b0b-b552-f0df17286d89'} Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:51:20.814004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. Aug 23 16:51:20.815553 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:20.817003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Returning 404 to user: Instance 91b213d8-efff-4b0b-b552-f0df17286d89 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:51:20.817003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2bfb7987-ab2a-4d65-ae5e-01b0f2464f5f tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89" status: 404 len: 111 microversion: 2.20 time: 0.030892 Aug 23 16:51:20.817003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 583/1141] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:51:20 2022] GET /compute/v2.1/servers/91b213d8-efff-4b0b-b552-f0df17286d89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:51:27.338894 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:27.339952 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:27.346866 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:27.347352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:27.347784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:27.348515 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:27.348957 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:27.349376 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:27.363769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] HTTP exception thrown: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Request method failure captured: Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: DELETE /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 HTTP/1.1 Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQMKtg-IuAzdOB2pLnbFp-5eAFrYAKiI_0sh0gH4o8WMpHEHi6kRpUDfJDoD9Xe8hUVnwRZATw4PoRaGr5DixCNw0qwy6kcBl7Wn1NuuKQiOJgtvpJNHoMmrbwCM8-n5uYKP8ezvD8LK6MDBy5JjV3efBltJn1pV5bbEkyW97F6osHU Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:51:27.365361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7bdf236fc9724490a26aeac2b680918b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 1ff570c1fa134bcebfd597ded5a95168 Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.367025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8'} Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:51:27.367851 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.369125 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.370342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Returning 404 to user: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:51:27.370342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8eb46852-3b48-49ff-8cc9-be4d4c179285 tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "DELETE /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 404 len: 111 microversion: 2.20 time: 0.031880 Aug 23 16:51:27.370342 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 559/1142] 10.222.0.52 () {60 vars in 1280 bytes} [Tue Aug 23 16:51:27 2022] DELETE /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:51:27.375749 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:27.377400 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] [instance: 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:27.382461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:27.382944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:27.383382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:27.384078 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:27.384573 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:27.385004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:27.398433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] HTTP exception thrown: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Request method failure captured: Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 HTTP/1.1 Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQMKtg-IuAzdOB2pLnbFp-5eAFrYAKiI_0sh0gH4o8WMpHEHi6kRpUDfJDoD9Xe8hUVnwRZATw4PoRaGr5DixCNw0qwy6kcBl7Wn1NuuKQiOJgtvpJNHoMmrbwCM8-n5uYKP8ezvD8LK6MDBy5JjV3efBltJn1pV5bbEkyW97F6osHU Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:51:27.400004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7bdf236fc9724490a26aeac2b680918b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7bdf236fc9724490a26aeac2b680918b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 7bdf236fc9724490a26aeac2b680918b Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1062727396 Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 1ff570c1fa134bcebfd597ded5a95168 Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1062727396-project Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.401762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8'} Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:51:27.403293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. Aug 23 16:51:27.404921 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:51:27.406279 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] Returning 404 to user: Instance 198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:51:27.406279 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b83f6399-7087-4a08-b02d-5031428af2ab tempest-AttachVolumeShelveTestJSON-1062727396 tempest-AttachVolumeShelveTestJSON-1062727396-project] 10.222.0.52 "GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8" status: 404 len: 111 microversion: 2.20 time: 0.029683 Aug 23 16:51:27.406279 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 584/1143] 10.222.0.52 () {60 vars in 1277 bytes} [Tue Aug 23 16:51:27 2022] GET /compute/v2.1/servers/198ef6b6-58f7-4ab3-a723-cf0e6c27b4f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 16:51:31.900786 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1279667883", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1743212429", "security_groups": [{"name": "tempest-secgroup-smoke-77226586"}], "networks": [{"uuid": "6f3f932b-fb37-419d-8d02-a38fbd490102"}], "block_device_mapping_v2": [{"uuid": "09ca129e-823f-450e-ada6-077eb16d8598", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:51:32.046959 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] validate_networks() for [('6f3f932b-fb37-419d-8d02-a38fbd490102', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:51:32.691348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:51:32.691768 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:51:32.692331 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:51:32.692739 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:51:32.693145 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:51:32.703460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:32.703958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:32.704418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:32.705130 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:32.705586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:32.705992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:32.723113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Getting quotas for project e40dd5c44be5454f9fbeefdd8ae7b45f. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:51:32.731392 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Getting quotas for user 866f33b28b714010a9807cd5a716939a and project e40dd5c44be5454f9fbeefdd8ae7b45f. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:51:32.796189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:51:32.798371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='09ca129e-823f-450e-ada6-077eb16d8598',volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:51:33.223351 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-25122188-5c71-46d3-a1de-ba3badf6a0d4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.327704 Aug 23 16:51:33.226044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 560/1144] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:51:31 2022] POST /compute/v2.1/servers => generated 404 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:51:33.240450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-612331db-6044-4125-aca2-35971ebc76e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:33.241819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-612331db-6044-4125-aca2-35971ebc76e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:33.303013 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-612331db-6044-4125-aca2-35971ebc76e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:33.310565 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-612331db-6044-4125-aca2-35971ebc76e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1089 microversion: 2.1 time: 0.075983 Aug 23 16:51:33.311473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 585/1145] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:33 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:34.335151 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-dff3f7e7-d1d4-492c-ae7e-750ff0da9594 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:34.336095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-dff3f7e7-d1d4-492c-ae7e-750ff0da9594 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:34.398129 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-dff3f7e7-d1d4-492c-ae7e-750ff0da9594 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:34.405911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-dff3f7e7-d1d4-492c-ae7e-750ff0da9594 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1089 microversion: 2.1 time: 0.074828 Aug 23 16:51:34.406824 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 561/1146] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:34 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:35.339252 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3e29dc1f-c3bc-4632-8b33-9da5bda983d5 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f677835b700>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:35.387217 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3e29dc1f-c3bc-4632-8b33-9da5bda983d5 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a7c98989-b824-437f-8f55-08407a5a096a" status: 200 len: 351 microversion: 2.1 time: 0.051728 Aug 23 16:51:35.387929 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 586/1147] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:51:35 2022] GET /compute/v2.1/os-volumes/a7c98989-b824-437f-8f55-08407a5a096a => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:35.426768 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:35.427373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:35.434508 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:35.434990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:35.435415 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:35.436101 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:35.436574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:35.436992 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:35.514455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:35.522936 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-052e8eef-9722-4637-a69f-be4d25f1abe5 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1187 microversion: 2.1 time: 0.099961 Aug 23 16:51:35.523796 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 562/1148] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:35 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1187 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:36.546794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:36.547410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:36.553543 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:36.560334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:36.560334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:36.560334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:36.560334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:36.561113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:36.638124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:36.649830 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1ba91c5a-b709-4d87-9f3e-056b0fdb8448 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1205 microversion: 2.1 time: 0.108161 Aug 23 16:51:36.651410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 587/1149] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:36 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1205 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:37.677932 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:37.678610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:37.685064 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:37.685539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:37.685971 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:37.686646 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:37.687087 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:37.687505 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:37.924883 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:37.933108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b5b98e05-ae2b-469c-8f05-c574de1f85f9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1271 microversion: 2.1 time: 0.258729 Aug 23 16:51:37.934673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 563/1150] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:37 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1271 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:38.137747 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-3931f077-169d-42a1-b615-d6cb0b46ce02 req-5842e846-6054-4c9a-a438-8148c5ca21cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823004bc-64c5-4d9c-872e-dc73ae7b49a3", "tag": "1f1d5f14-7a98-4e47-b015-c2247fabb0b8"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:51:38.148248 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-3931f077-169d-42a1-b615-d6cb0b46ce02 req-5842e846-6054-4c9a-a438-8148c5ca21cd service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:38.148676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-3931f077-169d-42a1-b615-d6cb0b46ce02 req-5842e846-6054-4c9a-a438-8148c5ca21cd service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:38.149097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-3931f077-169d-42a1-b615-d6cb0b46ce02 req-5842e846-6054-4c9a-a438-8148c5ca21cd service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:38.161176 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-3931f077-169d-42a1-b615-d6cb0b46ce02 req-5842e846-6054-4c9a-a438-8148c5ca21cd service nova] Creating event network-changed:1f1d5f14-7a98-4e47-b015-c2247fabb0b8 for instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 on hv-cinder-85032 Aug 23 16:51:38.175792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-3931f077-169d-42a1-b615-d6cb0b46ce02 req-5842e846-6054-4c9a-a438-8148c5ca21cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032084 Aug 23 16:51:38.175792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 588/1151] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:38.378889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f2c4ac15-3880-429e-a149-528bc3a5e83c tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f6779fefd30>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:38.430145 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f2c4ac15-3880-429e-a149-528bc3a5e83c tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/7e59190a-95ec-4375-a5dc-052c97d85fdf" status: 200 len: 349 microversion: 2.1 time: 0.055226 Aug 23 16:51:38.430835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 564/1152] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:51:38 2022] GET /compute/v2.1/os-volumes/7e59190a-95ec-4375-a5dc-052c97d85fdf => generated 349 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:38.958082 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:38.958790 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:38.965273 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:38.965762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:38.966417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:38.967291 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:38.967917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:38.968536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:39.103337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:39.111417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a28afdb5-d67d-4e23-9b25-df0c69e7d6e4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.157498 Aug 23 16:51:39.112042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 589/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:38 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:40.023254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9c117139-cc3e-4603-bb50-aae26e4e2f9e tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f6778271c10>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.069352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9c117139-cc3e-4603-bb50-aae26e4e2f9e tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d50d93f7-bc30-4d31-9e2f-1bc55f643ced" status: 200 len: 351 microversion: 2.1 time: 0.052910 Aug 23 16:51:40.069352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 565/1154] 10.222.0.52 () {58 vars in 1245 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/os-volumes/d50d93f7-bc30-4d31-9e2f-1bc55f643ced => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:40.080803 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8bdf4cc6-0bda-44fa-9d7c-835296000470 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f677835b8b0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.143075 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.143609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:40.150497 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:40.150979 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:40.151412 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:40.152104 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:40.152685 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:40.153040 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:40.172826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8bdf4cc6-0bda-44fa-9d7c-835296000470 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092837 Aug 23 16:51:40.172826 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 590/1155] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:40.183877 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9d62b134-d48c-41fe-b7d7-5e5937856b25 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f67781d0430>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.268401 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9d62b134-d48c-41fe-b7d7-5e5937856b25 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088252 Aug 23 16:51:40.269058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 591/1156] 10.222.0.52 () {58 vars in 1149 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:51:40.282534 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-18c97c79-dd75-4ef7-8352-27de58ca3806 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f67781e79d0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.298238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:40.306134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-92888fe5-d94c-4937-8043-05a953c375d9 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.167491 Aug 23 16:51:40.308241 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 566/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:51:40.364708 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-18c97c79-dd75-4ef7-8352-27de58ca3806 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086379 Aug 23 16:51:40.365279 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 592/1158] 10.222.0.52 () {58 vars in 1134 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:51:40.377778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-68711262-a5ac-4089-bfa3-0b462fb643e4 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f6779fd7430>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.459945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-68711262-a5ac-4089-bfa3-0b462fb643e4 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.085826 Aug 23 16:51:40.460541 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 567/1159] 10.222.0.52 () {58 vars in 1167 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:40.473546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8a55e7d9-a8d8-4d64-8b69-213905e68a79 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f677c8eaee0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.555009 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8a55e7d9-a8d8-4d64-8b69-213905e68a79 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.085189 Aug 23 16:51:40.555609 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 593/1160] 10.222.0.52 () {58 vars in 1170 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:40.568967 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d8fdfd05-1541-4874-a16d-39df60e30b16 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f67784be3a0>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.650276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d8fdfd05-1541-4874-a16d-39df60e30b16 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084848 Aug 23 16:51:40.780200 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 568/1161] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:40.781382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-392b276d-d660-4145-9e09-65906f7e0f63 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f6778213430>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.781382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-392b276d-d660-4145-9e09-65906f7e0f63 tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.095732 Aug 23 16:51:40.781382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 594/1162] 10.222.0.52 () {58 vars in 1188 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:40.781659 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4e8fe498-d962-4c2e-bb92-da1a9d43193c tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] Calling method '.version_select at 0x7f677839cb80>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:40.859987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4e8fe498-d962-4c2e-bb92-da1a9d43193c tempest-VolumesTestJSON-1361956407 tempest-VolumesTestJSON-1361956407-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090737 Aug 23 16:51:40.860651 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 569/1163] 10.222.0.52 () {58 vars in 1155 bytes} [Tue Aug 23 16:51:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:41.331266 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:41.331879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:41.338025 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:41.338500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:41.338935 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:41.339626 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:41.340074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:41.340522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:41.479033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:41.489071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e0498473-6336-4420-afad-4062d3645ba4 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.161961 Aug 23 16:51:41.489654 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 595/1164] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:41 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:42.509949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:42.511002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:42.517911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:42.518391 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:42.518815 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:42.519505 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:42.520042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:42.520405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:42.663877 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:42.674875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f0cd2f6a-05b0-4dd2-b93a-09da57bf8019 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.167832 Aug 23 16:51:42.674875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 570/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:42 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:43.695061 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:43.695734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:43.698193 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:43.698897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:43.703764 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:43.704410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:43.704869 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:43.705441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:43.705898 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:43.706327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:43.850394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:43.857975 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-47c2ac0d-e546-48b7-a0fc-dab6adcf5dd2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.166992 Aug 23 16:51:43.858848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 596/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:43 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:44.878601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:44.879215 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:44.881194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:44.882402 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=8 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:44.883116 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:44.887731 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:44.888553 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:44.888771 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:44.890001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:44.890493 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:44.890923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:44.895065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:45.024381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:45.032267 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8eba87c4-46c5-4ce0-ae69-2e069f205340 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.157713 Aug 23 16:51:45.037710 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 571/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:44 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:46.054211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:46.054886 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:46.061638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:46.064052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:46.064052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:46.064052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:46.064052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:46.064540 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:46.068074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=57 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:51:46.203399 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:46.211006 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cd9f2193-1ba8-4f0e-b55c-9931431bf3aa tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.161566 Aug 23 16:51:46.211610 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 597/1168] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:46 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:47.234807 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:47.235563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:47.243719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:47.244228 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:47.244666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:47.245362 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:47.245814 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:47.246244 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:47.382563 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:47.390371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9dc8b876-7965-4fb9-a53d-46833554c873 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.160941 Aug 23 16:51:47.390975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 572/1169] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:47 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:48.411076 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:48.411716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:48.419265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:48.419688 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:48.420133 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:48.420894 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:48.421659 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:48.422093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:48.570316 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:48.580200 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d5c45bdb-21ad-4fce-bf19-816043259bef tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.173078 Aug 23 16:51:48.580879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 598/1170] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:48 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:49.605879 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:49.607029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:49.615380 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:49.615870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:49.616496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:49.617205 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:49.617656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:49.618079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:49.757406 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:49.765446 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-49576e9c-525e-4cb2-ab46-25ccc1521331 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.164022 Aug 23 16:51:49.766029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 573/1171] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:49 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:50.786904 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:50.787542 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:50.794935 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:50.796321 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:50.796923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:50.797890 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:50.798686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:50.799326 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:50.957442 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:50.965310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ef98c099-0666-4df4-a3ef-1ac59ba4295a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.183601 Aug 23 16:51:50.978803 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 599/1172] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:50 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:51.007442 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-58871641-4f96-4f5d-b99f-fb8b348a72a3 req-67057030-3596-45e4-aaaa-f107f63bf017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823004bc-64c5-4d9c-872e-dc73ae7b49a3", "name": "network-vif-plugged", "status": "completed", "tag": "1f1d5f14-7a98-4e47-b015-c2247fabb0b8"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:51:51.017567 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-58871641-4f96-4f5d-b99f-fb8b348a72a3 req-67057030-3596-45e4-aaaa-f107f63bf017 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:51.018047 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-58871641-4f96-4f5d-b99f-fb8b348a72a3 req-67057030-3596-45e4-aaaa-f107f63bf017 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:51.018473 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-58871641-4f96-4f5d-b99f-fb8b348a72a3 req-67057030-3596-45e4-aaaa-f107f63bf017 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:51.030474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-58871641-4f96-4f5d-b99f-fb8b348a72a3 req-67057030-3596-45e4-aaaa-f107f63bf017 service nova] Creating event network-vif-plugged:1f1d5f14-7a98-4e47-b015-c2247fabb0b8 for instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 on hv-cinder-85032 Aug 23 16:51:51.035606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-58871641-4f96-4f5d-b99f-fb8b348a72a3 req-67057030-3596-45e4-aaaa-f107f63bf017 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181289 Aug 23 16:51:51.036230 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 574/1173] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:51:51.989295 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:51.989295 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:51.994043 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:51.994519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:51.994961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:51.995661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:51.996123 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:51.996578 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:52.140541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:52.148421 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-19feb40e-14ce-4ca3-a930-44562ce95c65 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.166116 Aug 23 16:51:52.152305 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 600/1174] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:51 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:53.170055 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:53.170673 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:53.177401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:53.177888 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:53.181224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:53.181224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:53.181224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:53.181224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:53.314149 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:53.321890 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0c02a76c-a842-48c5-bd01-77252a9b005f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1259 microversion: 2.1 time: 0.156640 Aug 23 16:51:53.322461 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 575/1175] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:53 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:54.342421 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:54.343035 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:54.352395 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:54.352395 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:54.352395 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:54.352395 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:54.353141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:54.354140 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:54.492338 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:54.500923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fb2cd6e2-30bf-4b23-9ddf-c497ce36106e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1443 microversion: 2.1 time: 0.162201 Aug 23 16:51:54.501434 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 601/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:54 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:54.522189 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:51:54.522846 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:51:54.529009 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:54.529603 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:54.530041 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:54.530736 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:54.531194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:54.531619 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:54.667156 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:51:54.675804 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-013fa28c-ca03-4ff7-804b-ed61339dd7ac tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1443 microversion: 2.1 time: 0.157738 Aug 23 16:51:54.676419 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 576/1177] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:51:54 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:51:57.058396 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-6399ec9d-96fc-4a51-8b86-3c4d5db37950 req-8c0ec054-eb1f-4027-93eb-bd2cb78b159a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823004bc-64c5-4d9c-872e-dc73ae7b49a3", "tag": "1f1d5f14-7a98-4e47-b015-c2247fabb0b8"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:51:57.067995 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-6399ec9d-96fc-4a51-8b86-3c4d5db37950 req-8c0ec054-eb1f-4027-93eb-bd2cb78b159a service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:51:57.068497 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-6399ec9d-96fc-4a51-8b86-3c4d5db37950 req-8c0ec054-eb1f-4027-93eb-bd2cb78b159a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:51:57.068923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-6399ec9d-96fc-4a51-8b86-3c4d5db37950 req-8c0ec054-eb1f-4027-93eb-bd2cb78b159a service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:51:57.080884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-6399ec9d-96fc-4a51-8b86-3c4d5db37950 req-8c0ec054-eb1f-4027-93eb-bd2cb78b159a service nova] Creating event network-changed:1f1d5f14-7a98-4e47-b015-c2247fabb0b8 for instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 on hv-cinder-85032 Aug 23 16:51:57.085916 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-6399ec9d-96fc-4a51-8b86-3c4d5db37950 req-8c0ec054-eb1f-4027-93eb-bd2cb78b159a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153556 Aug 23 16:51:57.086673 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 602/1178] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:52:12.301509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 16:52:12.302125 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Tue Aug 23 16:52:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 16:53:07.807908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=11 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:07.808701 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=31 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:07.812696 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3efeb2b1-3c11-4c7a-a40f-153c288bbf47 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Action: 'create', calling method: .version_select at 0x7f677820dee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-546791381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQgdhW9379CjCtx0+sIlAhyjvRcIOj2lW+UyCyxWvl6lv4F41COcajA2NXTnRjJDQ6wSKVTmwhlzhNVG+bW6LfYuto/RdKUT3Yydxes4kwKtdg1rcXfNVvEqLokB3VbCg=="}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:53:07.827770 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-3efeb2b1-3c11-4c7a-a40f-153c288bbf47 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Getting quotas for project 1d9325e2d8c244a89bd64606ce752496. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:53:07.831770 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-3efeb2b1-3c11-4c7a-a40f-153c288bbf47 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Getting quotas for user cb7aef18e7ca450b99f25928bb4e016c and project 1d9325e2d8c244a89bd64606ce752496. Resources: {'key_pairs'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:53:07.926226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3efeb2b1-3c11-4c7a-a40f-153c288bbf47 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.120002 Aug 23 16:53:07.926865 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 577/1179] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:53:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:53:07.975287 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=13 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:07.976071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=31 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:07.980647 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-262675596", "imageRef": "1ba36fad-d50c-44d2-9f3d-9d5e1afdbbbc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-546791381", "networks": [{"uuid": "5160110c-2e13-4160-bf9e-0d57d52de12a"}]}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:53:08.032300 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] validate_networks() for [('5160110c-2e13-4160-bf9e-0d57d52de12a', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:53:08.542639 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:53:08.543220 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:53:08.543814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:53:08.544121 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:53:08.544611 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:53:08.555091 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:08.555800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:08.556325 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:08.557062 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:08.557522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:08.557950 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:08.576781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Getting quotas for project 1d9325e2d8c244a89bd64606ce752496. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:53:08.583784 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Getting quotas for user cb7aef18e7ca450b99f25928bb4e016c and project 1d9325e2d8c244a89bd64606ce752496. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:53:08.599795 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:53:08.603232 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1ba36fad-d50c-44d2-9f3d-9d5e1afdbbbc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:53:08.775135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6462d4d4-b28d-4c11-bc25-582bc546df14 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802088 Aug 23 16:53:08.781677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 603/1180] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:53:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:53:08.787074 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-990b8386-fdbb-4822-bd2b-4e4f9f9381eb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:08.787686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-990b8386-fdbb-4822-bd2b-4e4f9f9381eb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:08.842476 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-990b8386-fdbb-4822-bd2b-4e4f9f9381eb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:08.849568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-990b8386-fdbb-4822-bd2b-4e4f9f9381eb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1257 microversion: 2.1 time: 0.066349 Aug 23 16:53:08.850136 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 578/1181] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:08 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:09.870678 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:09.871677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:09.879692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:09.880203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:09.880773 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:09.881489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:09.882019 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:09.882455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:09.945522 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:09.953998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-c8a83642-1bea-416d-a667-f300558a1645 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1261 microversion: 2.1 time: 0.088132 Aug 23 16:53:09.954639 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 604/1182] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:09 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:10.974613 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:10.975154 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:10.982356 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:10.982828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:10.983254 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:10.984206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:10.984656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:10.985072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:11.071129 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:11.078908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2adbbd1b-fb3e-4148-b136-65cbb3d2e713 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1317 microversion: 2.1 time: 0.108126 Aug 23 16:53:11.079488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 579/1183] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:10 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:12.105361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:12.106856 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:12.117169 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:12.118319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:12.119006 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:12.119966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:12.120598 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:12.121175 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:12.312403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:12.320685 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a41e6dd5-3294-43e7-8a42-b57eaf228d98 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.221359 Aug 23 16:53:12.321968 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 605/1184] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:12 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:13.342042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:13.342641 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:13.349198 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:13.349719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:13.350150 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:13.350847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:13.351293 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:13.351713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:13.498234 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:13.508207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3c2a3711-564d-4ecb-bcc9-9bb861b61dd9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.169858 Aug 23 16:53:13.509237 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 580/1185] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:13 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:14.529205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:14.529996 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:14.536967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:14.537539 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:14.538051 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:14.538850 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:14.539381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:14.539881 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:14.679343 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:14.687531 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-812ea2be-ac48-4737-84ce-756373000972 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.162039 Aug 23 16:53:14.688537 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 606/1186] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:14 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:15.710769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:15.711718 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:15.719611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:15.720003 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:15.720470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:15.721216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:15.721668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:15.722239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:15.869072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:15.877535 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-75c9c078-b3a7-4d7d-bb19-411f5fa08047 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.171878 Aug 23 16:53:15.879905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 581/1187] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:15 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:16.900983 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:16.901582 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:16.907900 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:16.908538 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:16.908986 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:16.909777 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:16.910241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:16.910665 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:17.049571 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:17.057759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-77f21844-0a74-4ee7-aa3b-9e1b26d54970 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.161822 Aug 23 16:53:17.058336 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 607/1188] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:16 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:18.078561 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:18.079191 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:18.085923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:18.086444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:18.086882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:18.087589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:18.088045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:18.088524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:18.234914 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:18.243916 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f2e4bedf-278c-4fa2-a00a-c34c855b4a3f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.169134 Aug 23 16:53:18.244753 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 582/1189] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:18 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:53:19.264780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:19.265368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:19.267648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:19.268396 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=6 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:19.273628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:19.274107 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:19.274545 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:19.275229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:19.275677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:19.276099 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:19.411040 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:19.419460 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f4e72511-86ef-43db-9a45-ac92f18022ab tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.158535 Aug 23 16:53:19.420023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 608/1190] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:19 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:20.440286 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:20.440958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:20.442789 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:20.448319 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:20.448806 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:20.449246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:20.449945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:20.450401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:20.450874 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:20.578278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:20.586326 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-defac71e-0c9e-47f7-a093-c3c6afa739cb tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.149948 Aug 23 16:53:20.586905 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 583/1191] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:20 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:21.607447 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:21.608088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:21.615116 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:21.620213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:21.620213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:21.620213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:21.620213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:21.620627 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:21.776376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:21.785661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8c8227be-c6b9-41ca-b925-7e844e785dba tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.181968 Aug 23 16:53:21.786165 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 609/1192] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:21 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:22.655570 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-bdf37c1e-03e7-4f7f-8e84-fdd4355fba75 req-46093acf-f96a-4b46-b21f-5340ac484b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d27d05d-835b-4e7b-ab51-cb7941c9f44b", "tag": "dd872c46-b5cc-4c27-83e0-14a444b9e18a"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:53:22.666151 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-bdf37c1e-03e7-4f7f-8e84-fdd4355fba75 req-46093acf-f96a-4b46-b21f-5340ac484b80 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:22.668281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-bdf37c1e-03e7-4f7f-8e84-fdd4355fba75 req-46093acf-f96a-4b46-b21f-5340ac484b80 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:22.668281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-bdf37c1e-03e7-4f7f-8e84-fdd4355fba75 req-46093acf-f96a-4b46-b21f-5340ac484b80 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:22.680807 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-bdf37c1e-03e7-4f7f-8e84-fdd4355fba75 req-46093acf-f96a-4b46-b21f-5340ac484b80 service nova] Creating event network-changed:dd872c46-b5cc-4c27-83e0-14a444b9e18a for instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b on hv-cinder-85032 Aug 23 16:53:22.686114 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-bdf37c1e-03e7-4f7f-8e84-fdd4355fba75 req-46093acf-f96a-4b46-b21f-5340ac484b80 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041097 Aug 23 16:53:22.691403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 584/1193] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:53:22.807058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:22.807681 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:22.814187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:22.814677 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:22.815123 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:22.815831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:22.816438 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:22.816756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:23.035913 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:23.044415 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f71e3257-ac37-4dd4-aeef-1d4918da76a2 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.241890 Aug 23 16:53:23.045475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 610/1194] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:22 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:24.066000 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:24.066689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:24.072751 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:24.073226 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:24.073656 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:24.074336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:24.074779 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:24.075195 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:24.222675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:24.232909 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bc419e26-a401-4dfc-be08-5bf778382c8c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.171411 Aug 23 16:53:24.233775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 585/1195] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:24 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:25.256895 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:25.257491 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:25.264012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:25.264519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:25.264952 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:25.265626 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:25.266073 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:25.266494 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:25.392253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:25.399894 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-11e7e16e-d095-42ea-af53-e5e5dbebbe3e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.147611 Aug 23 16:53:25.400492 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 611/1196] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:25 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:26.419926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:26.420576 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:26.426979 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:26.427450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:26.427882 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:26.428587 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:26.429030 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:26.429444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:26.560841 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:26.568527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9eb056d4-7a82-4a32-a95a-98424e2b012b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.152383 Aug 23 16:53:26.569097 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 586/1197] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:26 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:27.589744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:27.590356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:27.596817 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:27.597293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:27.597726 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:27.598417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:27.598865 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:27.599285 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:27.734357 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:27.741927 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-83e24c77-bb0a-45fb-9c83-37273d05860f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.156572 Aug 23 16:53:27.742489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 612/1198] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:27 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:53:28.763073 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:28.763686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:28.770228 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:28.770703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:28.771137 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:28.771821 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:28.772300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:28.772724 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:28.906046 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:28.913993 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5b713818-a6f5-4301-8ee0-40ca18fa5af7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.154795 Aug 23 16:53:28.914622 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 587/1199] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:28 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:29.288036 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-dfb47501-c794-48bd-92f4-01d556e8b14c req-6d1ba830-c4a9-4975-b86e-6378abf4c641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d27d05d-835b-4e7b-ab51-cb7941c9f44b", "name": "network-vif-plugged", "status": "completed", "tag": "dd872c46-b5cc-4c27-83e0-14a444b9e18a"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:53:29.298864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-dfb47501-c794-48bd-92f4-01d556e8b14c req-6d1ba830-c4a9-4975-b86e-6378abf4c641 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:29.299344 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-dfb47501-c794-48bd-92f4-01d556e8b14c req-6d1ba830-c4a9-4975-b86e-6378abf4c641 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:29.299781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-dfb47501-c794-48bd-92f4-01d556e8b14c req-6d1ba830-c4a9-4975-b86e-6378abf4c641 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:29.311516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-dfb47501-c794-48bd-92f4-01d556e8b14c req-6d1ba830-c4a9-4975-b86e-6378abf4c641 service nova] Creating event network-vif-plugged:dd872c46-b5cc-4c27-83e0-14a444b9e18a for instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b on hv-cinder-85032 Aug 23 16:53:29.316603 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-dfb47501-c794-48bd-92f4-01d556e8b14c req-6d1ba830-c4a9-4975-b86e-6378abf4c641 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032534 Aug 23 16:53:29.317277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 613/1200] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:53:29.934534 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:29.935095 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:29.941531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:29.941946 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:29.942383 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:29.943076 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:29.943530 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:29.943958 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:30.078879 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:30.087251 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-13602c9b-85c0-41b4-910a-b8ae8b53bc83 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1357 microversion: 2.1 time: 0.156678 Aug 23 16:53:30.087827 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 588/1201] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:29 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:31.109400 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:31.110186 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:31.116564 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:31.117084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:31.117525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:31.118221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:31.118675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:31.119106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:31.250597 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:31.258473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5cde4b25-c34a-4fe5-b308-0bbe5c210f93 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1547 microversion: 2.1 time: 0.154276 Aug 23 16:53:31.259059 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 614/1202] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:31 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:31.278705 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:31.283715 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:31.286107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:31.286591 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:31.287133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:31.287833 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:31.288316 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:31.288785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:31.420778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:31.428699 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b9e9ed1e-9223-4cc1-af08-c7d78ac0d3d9 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1547 microversion: 2.1 time: 0.153838 Aug 23 16:53:31.429864 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 589/1203] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:31 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:53:31.449492 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:31.454327 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:31.455093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Searching by: {'deleted': False, 'project_id': '1d9325e2d8c244a89bd64606ce752496'} {{(pid=133198) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 16:53:31.461903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:31.462389 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:31.462832 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:31.463559 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:31.464015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:31.464473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:31.557811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.multi_cell_list [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=133198) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 16:53:31.652620 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1e8b8fbd-546d-48db-8167-1f8ce2db02ca tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.207327 Aug 23 16:53:31.653157 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 615/1204] 10.222.0.52 () {58 vars in 1125 bytes} [Tue Aug 23 16:53:31 2022] GET /compute/v2.1/servers => generated 342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:53:31.664311 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:31.664927 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:31.671123 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:31.671599 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:31.672085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:31.672801 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:31.673314 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:31.673738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:31.806496 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:31.814255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-50c51fb7-410f-4125-8666-ed03416b606f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1547 microversion: 2.1 time: 0.153844 Aug 23 16:53:31.814823 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 590/1205] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:31 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:33.627985 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-75f81be7-6aa9-4d3b-8fed-f2f87eecb64c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f46334fb-0f81-42b6-9b17-b3d44cd865a2"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:53:33.630382 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-75f81be7-6aa9-4d3b-8fed-f2f87eecb64c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:33.637557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75f81be7-6aa9-4d3b-8fed-f2f87eecb64c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:33.638050 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75f81be7-6aa9-4d3b-8fed-f2f87eecb64c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:33.638503 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75f81be7-6aa9-4d3b-8fed-f2f87eecb64c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:33.639264 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75f81be7-6aa9-4d3b-8fed-f2f87eecb64c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:33.639908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75f81be7-6aa9-4d3b-8fed-f2f87eecb64c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:33.640141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-75f81be7-6aa9-4d3b-8fed-f2f87eecb64c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:34.562627 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-75f81be7-6aa9-4d3b-8fed-f2f87eecb64c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "POST /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938493 Aug 23 16:53:34.563247 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 616/1206] 10.222.0.52 () {60 vars in 1323 bytes} [Tue Aug 23 16:53:33 2022] POST /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments => generated 194 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:53:42.139785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:42.140426 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:42.143035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:42.143703 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=68 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:42.148396 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:42.148875 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:42.149384 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:42.150070 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:42.150547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:42.150987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:42.328530 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:42.337329 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-dec57d58-27f6-466c-8908-82788760634d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1593 microversion: 2.1 time: 0.201428 Aug 23 16:53:42.337899 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 591/1207] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:42 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1593 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:53:44.239453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:44.244810 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:44.248901 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-749852e7-d913-47fb-bc75-c13508edc7eb req-45786762-15e7-49c1-b7c0-c653ab6fb995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d27d05d-835b-4e7b-ab51-cb7941c9f44b", "tag": "dd872c46-b5cc-4c27-83e0-14a444b9e18a"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:53:44.264536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-749852e7-d913-47fb-bc75-c13508edc7eb req-45786762-15e7-49c1-b7c0-c653ab6fb995 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:44.265285 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-749852e7-d913-47fb-bc75-c13508edc7eb req-45786762-15e7-49c1-b7c0-c653ab6fb995 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:44.265889 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-749852e7-d913-47fb-bc75-c13508edc7eb req-45786762-15e7-49c1-b7c0-c653ab6fb995 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:44.270662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:53:44.277596 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-749852e7-d913-47fb-bc75-c13508edc7eb req-45786762-15e7-49c1-b7c0-c653ab6fb995 service nova] Creating event network-changed:dd872c46-b5cc-4c27-83e0-14a444b9e18a for instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b on hv-cinder-85032 Aug 23 16:53:44.282825 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-749852e7-d913-47fb-bc75-c13508edc7eb req-45786762-15e7-49c1-b7c0-c653ab6fb995 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044624 Aug 23 16:53:44.283627 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 617/1208] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:53:46.374300 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1932013511"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:53:46.374859 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:46.381505 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:46.381989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:46.382426 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:46.383120 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:46.384256 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:46.384689 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:46.515326 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.network.security_group_api [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Adding security group 4695927b-ad8c-496d-97f8-5aafc59a4b4b to port dd872c46-b5cc-4c27-83e0-14a444b9e18a Aug 23 16:53:46.885823 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-828d8a70-51d2-41ad-a2d8-b236c13ca28c tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "POST /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/action" status: 202 len: 0 microversion: 2.1 time: 0.514951 Aug 23 16:53:46.885939 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 592/1209] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:53:46 2022] POST /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:53:46.895486 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-b72f7d5e-7c5b-4ef5-b679-a5e7b83fe756 req-a918331d-8bb0-40ef-904b-31f17a9e3b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d27d05d-835b-4e7b-ab51-cb7941c9f44b", "tag": "dd872c46-b5cc-4c27-83e0-14a444b9e18a"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:53:46.898028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:53:46.899703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:53:46.905299 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-b72f7d5e-7c5b-4ef5-b679-a5e7b83fe756 req-a918331d-8bb0-40ef-904b-31f17a9e3b2c service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:46.905776 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-b72f7d5e-7c5b-4ef5-b679-a5e7b83fe756 req-a918331d-8bb0-40ef-904b-31f17a9e3b2c service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:46.906235 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-b72f7d5e-7c5b-4ef5-b679-a5e7b83fe756 req-a918331d-8bb0-40ef-904b-31f17a9e3b2c service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:46.908309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:46.908309 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:46.908987 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:46.910272 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:53:46.910446 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:53:46.910940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:53:46.920829 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-b72f7d5e-7c5b-4ef5-b679-a5e7b83fe756 req-a918331d-8bb0-40ef-904b-31f17a9e3b2c service nova] Creating event network-changed:dd872c46-b5cc-4c27-83e0-14a444b9e18a for instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b on hv-cinder-85032 Aug 23 16:53:46.925956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-b72f7d5e-7c5b-4ef5-b679-a5e7b83fe756 req-a918331d-8bb0-40ef-904b-31f17a9e3b2c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034122 Aug 23 16:53:46.931483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 593/1210] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:53:47.132361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:53:47.141290 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5abe5535-c60d-4f31-913e-1b3f53dcb118 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1758 microversion: 2.1 time: 0.250889 Aug 23 16:53:47.142071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 618/1211] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:53:46 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1758 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:54:12.839010 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=6 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:54:12.839857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=12 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:54:12.843981 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:54:12.844617 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:12.851758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:12.852250 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:12.852675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:12.853346 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:12.853788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:12.854201 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:12.879726 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lazy-loading 'flavor' on Instance uuid 823004bc-64c5-4d9c-872e-dc73ae7b49a3 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:54:13.168199 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-eacde13f-25c1-4607-85c8-43171659d656 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "POST /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3/action" status: 202 len: 0 microversion: 2.1 time: 0.330417 Aug 23 16:54:13.168693 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 594/1212] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:54:12 2022] POST /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:54:13.177493 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:13.178090 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:13.180633 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=4 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:54:13.181294 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=7 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:54:13.188662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:13.188662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:13.188662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:13.188662 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:13.189056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:13.189056 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:13.330084 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:13.337903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fdb49cad-14f6-46eb-8090-ed05d3056595 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.164220 Aug 23 16:54:13.338472 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 619/1213] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:13 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:14.360220 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:14.360932 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:14.367728 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:14.368236 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:14.368682 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:14.369373 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:14.369826 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:14.370251 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:14.505518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:14.513336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2e402823-706a-465b-9b85-11b3c0e21366 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.158120 Aug 23 16:54:14.513900 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 595/1214] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:14 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:15.533557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:15.534175 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:15.541237 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:15.541725 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:15.542164 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:15.542863 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:15.543314 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:15.543735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:15.683923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:15.692728 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0ed6d2e6-f54f-4a88-a4e5-dfbb59d06826 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.163077 Aug 23 16:54:15.693291 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 620/1215] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:15 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:16.713987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:16.714605 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:16.721661 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:16.722141 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:16.722575 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:16.723265 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:16.723716 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:16.724141 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:16.855790 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:16.864523 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-05f88df2-9a9e-4cbc-988c-b7b892376838 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.154408 Aug 23 16:54:16.865093 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 596/1216] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:16 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:17.885218 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:17.885839 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:17.892862 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:17.893291 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:17.893731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:17.894423 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:17.894880 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:17.895339 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:18.024131 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:18.032607 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-de108332-793c-4e3a-afcd-4e5517af9236 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.151236 Aug 23 16:54:18.033180 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 621/1217] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:17 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:19.052551 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:19.053171 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:19.059621 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:19.060104 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:19.060570 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:19.061754 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:19.062209 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:19.062636 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:19.195182 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:19.203565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-22cf53a2-4228-4298-b846-604374e03064 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.154912 Aug 23 16:54:19.204133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 597/1218] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:19 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:20.224428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:20.225040 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:20.231423 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:20.231848 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:20.232312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:20.233001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:20.233455 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:20.234135 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:20.362361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:20.369956 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-fff4fcbc-3702-4a0c-a990-4ca34b8eb4c0 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.149376 Aug 23 16:54:20.370519 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 622/1219] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:20 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:21.391695 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:21.392470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:21.398903 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:21.399382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:21.399812 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:21.400524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:21.400972 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:21.401394 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:21.538313 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:21.546371 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6f73f947-75db-495f-a1b1-bea521546a7a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.158610 Aug 23 16:54:21.546948 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 598/1220] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:21 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:22.567417 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:22.568066 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:22.574436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:22.574923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:22.575364 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:22.576060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:22.576546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:22.576978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:22.706447 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:22.714482 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-3f6bb643-f214-477b-a611-deb7ee457014 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.150834 Aug 23 16:54:22.715087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 623/1221] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:22 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:23.736768 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:23.737404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:23.743908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:23.744420 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:23.744854 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:23.745600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:23.746050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:23.746594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:23.939580 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:23.947204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d11db332-84b2-43dd-8028-e95153fa3b0b tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.215150 Aug 23 16:54:23.947777 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 599/1222] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:23 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:24.967733 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:24.968342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:24.974807 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:24.975290 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:24.975729 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:24.976447 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:24.976912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:24.977341 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:25.109042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:25.116649 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2622fe90-2f43-4e1f-8e50-07ba01683047 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.152817 Aug 23 16:54:25.117213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 624/1223] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:24 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:26.143470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:26.144288 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:26.150198 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:26.150684 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:26.151116 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:26.151852 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:26.152334 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:26.157328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:26.287684 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:26.295393 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-92e3c379-9b7c-42c6-9a66-77b010c8ea37 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.161428 Aug 23 16:54:26.297008 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 600/1224] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:26 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:27.316654 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:27.317277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:27.323367 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:27.323849 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:27.324318 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:27.325008 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:27.325467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:27.325897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:27.458803 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:27.466647 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8d1d7c6e-2100-49ce-a4cc-73b5414434fe tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1508 microversion: 2.1 time: 0.153862 Aug 23 16:54:27.467221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 625/1225] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:27 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:27.487562 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:54:27.488190 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:27.494483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:27.494956 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:27.495380 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:27.496054 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:27.496520 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:27.496935 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:27.524408 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=133199) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 16:54:27.735784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-20b0561a-4eb0-4d06-ac3f-8d7db31d598a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "POST /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3/action" status: 202 len: 0 microversion: 2.1 time: 0.252334 Aug 23 16:54:27.736423 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 601/1226] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:54:27 2022] POST /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:54:27.744616 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:27.745236 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:27.751139 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:27.751628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:27.752075 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:27.752843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:27.753304 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:27.753731 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:27.889210 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:27.897871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4dc97d73-6644-4a73-9042-298445135f56 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1516 microversion: 2.1 time: 0.157037 Aug 23 16:54:27.898499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 626/1227] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:27 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:28.919140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:28.919650 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:28.926267 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:28.926747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:28.927180 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:28.927892 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:28.928378 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:28.928795 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:29.061606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:29.069307 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5bd8c389-25c3-4102-a12f-8d5a77a706ec tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1518 microversion: 2.1 time: 0.154594 Aug 23 16:54:29.069879 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 602/1228] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:28 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:29.440469 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-0ca2f49f-39ce-4459-a452-6b0379cfb8f3 req-e1fcfad9-5b2e-49aa-a745-e24a159212f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823004bc-64c5-4d9c-872e-dc73ae7b49a3", "name": "network-vif-unplugged", "status": "completed", "tag": "1f1d5f14-7a98-4e47-b015-c2247fabb0b8"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:54:29.450424 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-0ca2f49f-39ce-4459-a452-6b0379cfb8f3 req-e1fcfad9-5b2e-49aa-a745-e24a159212f8 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:29.450902 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-0ca2f49f-39ce-4459-a452-6b0379cfb8f3 req-e1fcfad9-5b2e-49aa-a745-e24a159212f8 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:29.451334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-0ca2f49f-39ce-4459-a452-6b0379cfb8f3 req-e1fcfad9-5b2e-49aa-a745-e24a159212f8 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:29.463184 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.compute.server_external_events [req-0ca2f49f-39ce-4459-a452-6b0379cfb8f3 req-e1fcfad9-5b2e-49aa-a745-e24a159212f8 service nova] Unable to find a host for instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3. Dropping event network-vif-unplugged {{(pid=133198) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 16:54:29.464071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-0ca2f49f-39ce-4459-a452-6b0379cfb8f3 req-e1fcfad9-5b2e-49aa-a745-e24a159212f8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027966 Aug 23 16:54:29.464739 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 627/1229] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 16:54:30.090899 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:30.091558 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:30.098531 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:30.099004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:30.099466 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:30.100401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:30.100847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:30.101265 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:30.232336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:30.240756 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2c2b1b22-90ab-4c08-991d-d44858fe100e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.153810 Aug 23 16:54:30.241315 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 603/1230] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:30 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:31.261874 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:31.262484 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:31.269347 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:31.269822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:31.270256 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:31.270939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:31.271390 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:31.271815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:31.406142 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:31.414584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ce53682a-0cab-48ec-b5fc-982a63c482dc tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.156522 Aug 23 16:54:31.415145 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 628/1231] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:31 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:32.435096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:32.435717 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:32.442410 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:32.442886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:32.443317 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:32.444002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:32.444483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:32.444900 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:32.573471 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:32.581263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b6aa4ab4-33dd-470d-88f9-f5608393aa3e tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.149915 Aug 23 16:54:32.581859 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 604/1232] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:32 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:54:33.602616 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:33.603229 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:33.609910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:33.610393 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:33.610827 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:33.611516 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:33.611966 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:33.612431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:33.744009 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:33.751563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b9fbd831-2736-4777-b4c5-8ee8df7347b6 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.152798 Aug 23 16:54:33.752129 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 629/1233] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:33 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:34.772570 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:34.773187 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:34.779686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:34.780174 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:34.780620 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:34.781305 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:34.782255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:34.782678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:34.913104 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:34.920836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-faa64f4c-175c-45d7-9cbd-8f2ec2c64e0d tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.152236 Aug 23 16:54:34.921405 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 605/1234] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:34 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:54:35.942405 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:35.942958 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:35.949716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:35.950196 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:35.950632 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:35.951319 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:35.951769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:35.952227 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:36.080876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:36.088443 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ca56d5ea-7292-463e-a619-d1183e746158 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.150126 Aug 23 16:54:36.089005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 630/1235] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:35 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:37.109605 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:37.110841 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:37.117273 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:37.117758 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:37.118196 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:37.118886 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:37.119340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:37.119763 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:37.252003 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:37.259792 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f5b88a1f-644a-4e89-bfe4-6725432f14b1 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.154284 Aug 23 16:54:37.260391 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 606/1236] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:37 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:38.281937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:38.282551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:38.289314 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:38.289802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:38.290241 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:38.290983 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:38.291437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:38.291861 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:38.424342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:38.432201 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4796ca69-60e3-4f17-889a-af4a4630b51a tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.154110 Aug 23 16:54:38.432765 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 631/1237] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:38 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:39.454472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:39.455085 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:39.461560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:39.462038 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:39.462675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:39.463374 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:39.463831 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:39.464277 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:39.482392 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:54:39.594231 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:39.602057 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-229f0742-00dc-430f-97c5-127fc04f8681 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.151505 Aug 23 16:54:39.602607 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 607/1238] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:39 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:40.622871 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:40.623411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:40.630259 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:40.630740 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:40.631234 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:40.631925 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:40.632400 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:40.632828 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:40.769394 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:40.777146 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-336d4eb4-9cf7-4bf4-aa23-e1ad20a0f63f tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.158191 Aug 23 16:54:40.777713 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 632/1239] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:40 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:41.541912 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-347c808c-d27a-458d-9b36-3e6badbee26a req-81b40e67-48d5-4c61-a782-efc932cf58b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823004bc-64c5-4d9c-872e-dc73ae7b49a3", "name": "network-vif-plugged", "status": "completed", "tag": "1f1d5f14-7a98-4e47-b015-c2247fabb0b8"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:54:41.552308 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-347c808c-d27a-458d-9b36-3e6badbee26a req-81b40e67-48d5-4c61-a782-efc932cf58b9 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:41.552780 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-347c808c-d27a-458d-9b36-3e6badbee26a req-81b40e67-48d5-4c61-a782-efc932cf58b9 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:41.553202 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-347c808c-d27a-458d-9b36-3e6badbee26a req-81b40e67-48d5-4c61-a782-efc932cf58b9 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:41.564239 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-347c808c-d27a-458d-9b36-3e6badbee26a req-81b40e67-48d5-4c61-a782-efc932cf58b9 service nova] Creating event network-vif-plugged:1f1d5f14-7a98-4e47-b015-c2247fabb0b8 for instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 on hv-cinder-85032 Aug 23 16:54:41.569202 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-347c808c-d27a-458d-9b36-3e6badbee26a req-81b40e67-48d5-4c61-a782-efc932cf58b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031052 Aug 23 16:54:41.569797 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 608/1240] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:54:41.798140 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:41.798744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:41.805143 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:41.809408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:41.809408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:41.809408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:41.809408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:41.809786 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:41.994774 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:42.002513 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-285f6e7b-f9b6-4d2c-ad66-210ff1269aea tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.208352 Aug 23 16:54:42.003081 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 633/1241] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:41 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:43.024975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:43.025680 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:43.027664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:54:43.032975 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:43.033449 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:43.033888 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:43.034604 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:43.035050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:43.035467 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:43.166593 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:43.175147 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-82efcfb0-7eaf-4fae-8230-33acdd6c6ee2 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1574 microversion: 2.1 time: 0.154757 Aug 23 16:54:43.175945 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 609/1242] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:43 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:44.194917 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:44.195548 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:44.197864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=31 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:54:44.202791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:44.203282 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:44.203722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:44.204541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:44.205033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:44.205501 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:44.209567 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=87 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:54:44.354132 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:44.362697 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-62eca11e-b174-462e-b1df-786e83a41614 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1561 microversion: 2.1 time: 0.171737 Aug 23 16:54:44.363261 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 634/1243] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:44 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:47.594923 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-84527aed-65cd-4bfd-9d15-5630c7d0f500 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:54:47.597475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-84527aed-65cd-4bfd-9d15-5630c7d0f500 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:47.604750 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84527aed-65cd-4bfd-9d15-5630c7d0f500 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:47.605262 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84527aed-65cd-4bfd-9d15-5630c7d0f500 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:47.605726 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84527aed-65cd-4bfd-9d15-5630c7d0f500 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:47.606435 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84527aed-65cd-4bfd-9d15-5630c7d0f500 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:47.606885 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84527aed-65cd-4bfd-9d15-5630c7d0f500 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:47.607304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-84527aed-65cd-4bfd-9d15-5630c7d0f500 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:47.783976 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-84527aed-65cd-4bfd-9d15-5630c7d0f500 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "POST /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/action" status: 202 len: 0 microversion: 2.1 time: 0.193563 Aug 23 16:54:47.785141 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 610/1244] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:54:47 2022] POST /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:54:47.793672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:47.794295 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:47.801448 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:47.801937 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:47.802380 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:47.803096 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:47.803653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:47.804087 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:47.954947 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:47.963434 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f6e9c01c-c11d-4529-a7f5-507ab2554d20 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1750 microversion: 2.1 time: 0.174453 Aug 23 16:54:47.964003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 635/1245] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:47 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:48.990169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:48.990876 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:48.997083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:48.997565 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:48.998002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:48.998687 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:48.999139 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:48.999560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:49.139535 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:49.147659 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-2e99f524-43d9-43a5-bae7-9e6eba096c61 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.162923 Aug 23 16:54:49.148257 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 611/1246] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:48 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:50.169197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:50.169815 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:50.176847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:50.177333 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:50.177780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:50.178473 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:50.178929 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:50.179361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:50.320696 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:50.328678 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a9b8304b-d43e-45a8-8df5-65a449f4285e tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.163358 Aug 23 16:54:50.329244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 636/1247] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:50 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:51.349570 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:51.350213 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:51.356683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:51.357164 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:51.357597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:51.358283 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:51.358990 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:51.359472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:51.503133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:51.511751 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1e8f7561-4b8c-4dbd-8db3-a625d9a404c1 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.166093 Aug 23 16:54:51.512340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 612/1248] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:51 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:52.533400 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:52.534040 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:52.540500 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:52.540986 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:52.541452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:52.542141 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:52.542600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:52.543028 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:52.686804 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:52.695585 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b4f19752-e331-4e42-b25c-1d3e5f14d128 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.166572 Aug 23 16:54:52.696158 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 637/1249] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:52 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:53.716980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:53.718103 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:53.724643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:53.725115 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:53.725537 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:53.726215 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:53.726657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:53.727071 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:53.867361 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:53.875479 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d5b12bff-e2a7-4fc8-a014-f1806566cf6f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.162303 Aug 23 16:54:53.878586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 613/1250] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:53 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:54.896727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:54.897353 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:54.903767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:54.904284 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:54.904733 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:54.905428 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:54.905887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:54.906810 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:55.045172 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:55.054013 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-61c063ba-9187-49ed-8e36-9b43c02cb940 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.161215 Aug 23 16:54:55.054586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 638/1251] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:54 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:56.074588 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:56.075206 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:56.081690 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:56.082179 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:56.082615 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:56.083304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:56.083757 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:56.084201 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:56.227276 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:56.238015 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c4b0f5d9-8d61-4ae6-9432-5845de76a10b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.167166 Aug 23 16:54:56.238701 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 614/1252] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:56 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:57.261663 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:57.262262 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:57.268298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:57.268783 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:57.269222 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:57.269910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:57.270369 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:57.270800 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:57.408629 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:57.416716 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-df5081a9-25aa-44b1-a99b-3e4e4068e126 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.159103 Aug 23 16:54:57.417281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 639/1253] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:57 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:58.438831 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:58.439448 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:58.446089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:58.449328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:58.449328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:58.449328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:58.449328 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:58.449752 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:58.590315 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:58.599056 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b294341a-80be-4d91-a746-e7b4962b2ada tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.164786 Aug 23 16:54:58.599623 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 615/1254] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:58 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:54:59.620831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:54:59.621439 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:54:59.628374 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:59.628851 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:59.629290 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:59.629969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:54:59.630418 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:54:59.630834 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:54:59.775651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:54:59.779663 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-bbdf8d09-b4c7-4cd3-bb54-5f23ce1de53a tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.162646 Aug 23 16:54:59.780240 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 640/1255] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:54:59 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:55:00.801004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:55:00.801621 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:55:00.808142 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:00.808659 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:00.809096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:00.809785 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:00.810586 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:00.811100 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:00.951618 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:55:00.960629 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-800e01e4-c654-4164-a97c-fb1644336912 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.163603 Aug 23 16:55:00.961193 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 616/1256] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:55:00 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:55:01.981060 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:55:01.981605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:55:01.988253 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:01.988738 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:01.989172 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:01.989867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:01.990320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:01.990749 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:02.130686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:55:02.138867 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-adde73d4-faf2-43f2-a3a2-2b393f4c1244 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.161699 Aug 23 16:55:02.139429 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 641/1257] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:55:01 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:55:03.160845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:55:03.161461 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:55:03.168224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:03.168702 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:03.169131 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:03.169826 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:03.170266 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:03.170679 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:03.311285 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:55:03.319567 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1f9a99c5-d83a-4ca6-8dec-11545b5fd508 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.163093 Aug 23 16:55:03.320145 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 617/1258] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:55:03 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:55:04.340461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:55:04.341074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:55:04.347375 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:04.347876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:04.348330 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:04.349029 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:04.349485 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:04.349913 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:04.494648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:55:04.503540 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-52960fec-aa1e-4f58-8ea2-a5194a35d1de tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1755 microversion: 2.1 time: 0.167246 Aug 23 16:55:04.504103 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 642/1259] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:55:04 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:55:05.524006 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:55:05.524644 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:55:05.531002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:05.531524 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:05.531948 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:05.532652 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:55:05.533099 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:55:05.533513 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:55:05.673988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:55:05.682278 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5f28af80-d13c-4933-a0a8-fd5d30d4a796 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1758 microversion: 2.1 time: 0.162117 Aug 23 16:55:05.682845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 618/1260] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:55:05 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:55:32.310722 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 16:55:32.311331 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Tue Aug 23 16:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 16:56:09.027648 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=17 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:09.028450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=53 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:09.033030 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1932013511"}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:56:09.033572 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:09.039399 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:09.048001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:09.048001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:09.048001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:09.048001 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:09.048451 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:09.166412 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.network.security_group_api [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Removing security group 4695927b-ad8c-496d-97f8-5aafc59a4b4b from port dd872c46-b5cc-4c27-83e0-14a444b9e18a Aug 23 16:56:09.520487 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-31f70589-3e02-42c7-bd88-d4c6e38a7ef3 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "POST /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/action" status: 202 len: 0 microversion: 2.1 time: 0.494460 Aug 23 16:56:09.521335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 643/1261] 10.222.0.52 () {60 vars in 1278 bytes} [Tue Aug 23 16:56:09 2022] POST /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:56:09.534930 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-d43806e2-dfcc-4866-9dcc-de88f2b30850 req-3f703cba-b17c-4923-9511-bcc7840b0ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d27d05d-835b-4e7b-ab51-cb7941c9f44b", "tag": "dd872c46-b5cc-4c27-83e0-14a444b9e18a"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:56:09.543468 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=19 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:09.544423 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:09.547470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-d43806e2-dfcc-4866-9dcc-de88f2b30850 req-3f703cba-b17c-4923-9511-bcc7840b0ec7 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:09.547632 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-d43806e2-dfcc-4866-9dcc-de88f2b30850 req-3f703cba-b17c-4923-9511-bcc7840b0ec7 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:09.548004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-d43806e2-dfcc-4866-9dcc-de88f2b30850 req-3f703cba-b17c-4923-9511-bcc7840b0ec7 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:09.561118 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-d43806e2-dfcc-4866-9dcc-de88f2b30850 req-3f703cba-b17c-4923-9511-bcc7840b0ec7 service nova] Creating event network-changed:dd872c46-b5cc-4c27-83e0-14a444b9e18a for instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b on hv-cinder-85032 Aug 23 16:56:09.566718 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-d43806e2-dfcc-4866-9dcc-de88f2b30850 req-3f703cba-b17c-4923-9511-bcc7840b0ec7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037558 Aug 23 16:56:09.567674 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 619/1262] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:56:10.700463 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:10.705467 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:10.710636 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-f18fb276-972d-4414-9c98-0d64610350ef req-486e5cd3-d726-4187-9fd1-0267aa6ce2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d27d05d-835b-4e7b-ab51-cb7941c9f44b", "tag": "dd872c46-b5cc-4c27-83e0-14a444b9e18a"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:56:10.712540 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:10.713096 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:10.713521 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:10.714220 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:10.714670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:10.715100 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:10.720869 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-f18fb276-972d-4414-9c98-0d64610350ef req-486e5cd3-d726-4187-9fd1-0267aa6ce2da service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:10.721345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-f18fb276-972d-4414-9c98-0d64610350ef req-486e5cd3-d726-4187-9fd1-0267aa6ce2da service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:10.721774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-f18fb276-972d-4414-9c98-0d64610350ef req-486e5cd3-d726-4187-9fd1-0267aa6ce2da service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:10.733683 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-f18fb276-972d-4414-9c98-0d64610350ef req-486e5cd3-d726-4187-9fd1-0267aa6ce2da service nova] Creating event network-changed:dd872c46-b5cc-4c27-83e0-14a444b9e18a for instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b on hv-cinder-85032 Aug 23 16:56:10.740068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-f18fb276-972d-4414-9c98-0d64610350ef req-486e5cd3-d726-4187-9fd1-0267aa6ce2da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033169 Aug 23 16:56:10.740068 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 620/1263] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:56:10.802972 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lazy-loading 'services' on Instance uuid 6d27d05d-835b-4e7b-ab51-cb7941c9f44b {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:56:11.034700 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e55de208-f3b7-41f1-b9f7-b40847c4039b tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments/f46334fb-0f81-42b6-9b17-b3d44cd865a2" status: 202 len: 0 microversion: 2.1 time: 0.338944 Aug 23 16:56:11.041058 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 644/1264] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:56:10 2022] DELETE /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments/f46334fb-0f81-42b6-9b17-b3d44cd865a2 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:56:11.044944 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-0a267285-4d66-4b3a-ba4f-4ed1fc88c995 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:11.047793 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-0a267285-4d66-4b3a-ba4f-4ed1fc88c995 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:11.054447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a267285-4d66-4b3a-ba4f-4ed1fc88c995 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:11.054850 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a267285-4d66-4b3a-ba4f-4ed1fc88c995 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:11.055523 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a267285-4d66-4b3a-ba4f-4ed1fc88c995 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:11.056527 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a267285-4d66-4b3a-ba4f-4ed1fc88c995 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:11.056999 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a267285-4d66-4b3a-ba4f-4ed1fc88c995 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:11.057403 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-0a267285-4d66-4b3a-ba4f-4ed1fc88c995 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:11.089380 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-0a267285-4d66-4b3a-ba4f-4ed1fc88c995 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049277 Aug 23 16:56:11.090306 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 621/1265] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:56:11 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:56:12.103258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a2f50d4c-4d2b-46c7-8510-7de71622bb92 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:12.105735 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a2f50d4c-4d2b-46c7-8510-7de71622bb92 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:12.112320 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2f50d4c-4d2b-46c7-8510-7de71622bb92 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:12.114600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2f50d4c-4d2b-46c7-8510-7de71622bb92 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:12.114600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2f50d4c-4d2b-46c7-8510-7de71622bb92 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:12.114600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2f50d4c-4d2b-46c7-8510-7de71622bb92 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:12.114600 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2f50d4c-4d2b-46c7-8510-7de71622bb92 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:12.114988 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a2f50d4c-4d2b-46c7-8510-7de71622bb92 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:12.144411 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a2f50d4c-4d2b-46c7-8510-7de71622bb92 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Aug 23 16:56:12.144965 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 645/1266] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:56:12 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:56:13.157518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-489c3c95-5caa-4945-9da7-1e09622c7489 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:13.159537 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-489c3c95-5caa-4945-9da7-1e09622c7489 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:13.165892 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-489c3c95-5caa-4945-9da7-1e09622c7489 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:13.166358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-489c3c95-5caa-4945-9da7-1e09622c7489 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:13.166784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-489c3c95-5caa-4945-9da7-1e09622c7489 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:13.167456 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-489c3c95-5caa-4945-9da7-1e09622c7489 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:13.167902 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-489c3c95-5caa-4945-9da7-1e09622c7489 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:13.168350 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-489c3c95-5caa-4945-9da7-1e09622c7489 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:13.195696 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-489c3c95-5caa-4945-9da7-1e09622c7489 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043237 Aug 23 16:56:13.196259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 622/1267] 10.222.0.52 () {58 vars in 1302 bytes} [Tue Aug 23 16:56:13 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 16:56:13.207005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:13.207499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:13.213883 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:13.214944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:13.214944 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:13.215478 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:13.215930 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:13.216392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:13.290335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] HTTP exception thrown: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b is not attached to volume f46334fb-0f81-42b6-9b17-b3d44cd865a2 Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Request method failure captured: Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: DELETE /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments/f46334fb-0f81-42b6-9b17-b3d44cd865a2 HTTP/1.1 Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQXii278tVcQXiQZIhrNc3_zyaC4MLRqlTcpklufxctGnAPTA_ZivYoTJeSy9qaQYixOEgzQgYPG383YyWvaWeOV4tZzq3WJvXAoQ8X872dZiUYTXXpCs19MqJ8DN4umpYKF7DffNx0xw1SkH6VboC4p-vi-mbqEoIC40Xcc7w_4rKw Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 1d9325e2d8c244a89bd64606ce752496 Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-TestMinimumBasicScenario-188834729 Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:56:13.292661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d9325e2d8c244a89bd64606ce752496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d9325e2d8c244a89bd64606ce752496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d9325e2d8c244a89bd64606ce752496", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d9325e2d8c244a89bd64606ce752496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-TestMinimumBasicScenario-188834729 Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 1d9325e2d8c244a89bd64606ce752496 Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-TestMinimumBasicScenario-188834729 Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-TestMinimumBasicScenario-188834729-project Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: cb7aef18e7ca450b99f25928bb4e016c Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-TestMinimumBasicScenario-188834729-project Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:56:13.294511 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b is not attached to volume f46334fb-0f81-42b6-9b17-b3d44cd865a2 Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'server_id': '6d27d05d-835b-4e7b-ab51-cb7941c9f44b', 'id': 'f46334fb-0f81-42b6-9b17-b3d44cd865a2'} Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f46334fb-0f81-42b6-9b17-b3d44cd865a2. Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:56:13.295489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b is not attached to volume f46334fb-0f81-42b6-9b17-b3d44cd865a2 Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b is not attached to volume f46334fb-0f81-42b6-9b17-b3d44cd865a2 Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:13.297138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Returning 404 to user: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b is not attached to volume f46334fb-0f81-42b6-9b17-b3d44cd865a2 {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:56:13.298551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-99dfbee9-ed25-4b21-9fd3-809011d8bd4f tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments/f46334fb-0f81-42b6-9b17-b3d44cd865a2" status: 404 len: 154 microversion: 2.1 time: 0.091604 Aug 23 16:56:13.298551 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 646/1268] 10.222.0.52 () {58 vars in 1416 bytes} [Tue Aug 23 16:56:13 2022] DELETE /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b/os-volume_attachments/f46334fb-0f81-42b6-9b17-b3d44cd865a2 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:56:14.571974 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:14.572499 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:14.579283 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:14.579762 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:14.580216 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:14.580907 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:14.581365 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:14.581788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:14.606600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:56:14.954852 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8c3a6582-0e3b-4d8a-b2ae-bc1f908f2305 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 204 len: 0 microversion: 2.1 time: 0.386281 Aug 23 16:56:14.955383 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 623/1269] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:56:14 2022] DELETE /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:56:14.964388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:14.965557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:14.973033 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:14.973524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:14.973968 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:14.974702 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:14.975159 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:14.975594 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:15.101311 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:56:15.109194 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5a0e19b7-2f32-40e2-bf6a-46e6e0c09cbe tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1553 microversion: 2.1 time: 0.148633 Aug 23 16:56:15.109756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 647/1270] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:14 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:56:16.131468 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:16.132181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:16.138626 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:16.139102 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:16.139536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:16.140258 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:16.140712 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:16.141137 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:16.271219 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:56:16.278803 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-037faf77-697e-46aa-a2c3-feb59f029f9d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1553 microversion: 2.1 time: 0.152204 Aug 23 16:56:16.279358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 624/1271] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:16 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:56:17.299557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:17.300365 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:17.306804 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:17.307290 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:17.307729 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:17.308461 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:17.308922 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:17.309355 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:17.520518 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:56:17.528189 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-86865a52-2b56-4916-a9dc-c7762a725ced tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1553 microversion: 2.1 time: 0.232932 Aug 23 16:56:17.528756 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 648/1272] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:17 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:56:17.789707 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-34a55134-c08c-49af-9609-cdee43f23f66 req-85e261ec-ccd3-4c23-8ced-9ade4c5cbdda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d27d05d-835b-4e7b-ab51-cb7941c9f44b", "name": "network-vif-deleted", "tag": "dd872c46-b5cc-4c27-83e0-14a444b9e18a"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:56:17.799511 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-34a55134-c08c-49af-9609-cdee43f23f66 req-85e261ec-ccd3-4c23-8ced-9ade4c5cbdda service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:17.799983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-34a55134-c08c-49af-9609-cdee43f23f66 req-85e261ec-ccd3-4c23-8ced-9ade4c5cbdda service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:17.800437 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-34a55134-c08c-49af-9609-cdee43f23f66 req-85e261ec-ccd3-4c23-8ced-9ade4c5cbdda service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:17.811133 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-34a55134-c08c-49af-9609-cdee43f23f66 req-85e261ec-ccd3-4c23-8ced-9ade4c5cbdda service nova] Creating event network-vif-deleted:dd872c46-b5cc-4c27-83e0-14a444b9e18a for instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b on hv-cinder-85032 Aug 23 16:56:17.816567 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-34a55134-c08c-49af-9609-cdee43f23f66 req-85e261ec-ccd3-4c23-8ced-9ade4c5cbdda service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089204 Aug 23 16:56:17.817149 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 625/1273] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:56:18.549723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:18.550340 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:18.556709 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:18.557197 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:18.557640 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:18.558344 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:18.558802 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:18.559232 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:18.591656 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:18.592315 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:18.592814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:18.593328 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lazy-loading 'fault' on Instance uuid 6d27d05d-835b-4e7b-ab51-cb7941c9f44b {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:56:18.635781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb7aef18e7ca450b99f25928bb4e016c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d9325e2d8c244a89bd64606ce752496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:56:18.642787 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-118a3df1-2b4c-406c-9b63-83fbb818aa0d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 200 len: 1347 microversion: 2.1 time: 0.097516 Aug 23 16:56:18.643400 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 649/1274] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:18 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 1347 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:56:19.663926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:19.664674 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [instance: 6d27d05d-835b-4e7b-ab51-cb7941c9f44b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:19.670774 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:19.671249 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:19.671675 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:19.672388 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:19.672836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:19.673252 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:19.686194 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] HTTP exception thrown: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b could not be found. Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Request method failure captured: Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b HTTP/1.1 Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQXii278tVcQXiQZIhrNc3_zyaC4MLRqlTcpklufxctGnAPTA_ZivYoTJeSy9qaQYixOEgzQgYPG383YyWvaWeOV4tZzq3WJvXAoQ8X872dZiUYTXXpCs19MqJ8DN4umpYKF7DffNx0xw1SkH6VboC4p-vi-mbqEoIC40Xcc7w_4rKw Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 1d9325e2d8c244a89bd64606ce752496 Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-TestMinimumBasicScenario-188834729 Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 16:56:19.687832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d9325e2d8c244a89bd64606ce752496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1d9325e2d8c244a89bd64606ce752496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1d9325e2d8c244a89bd64606ce752496", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1d9325e2d8c244a89bd64606ce752496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-TestMinimumBasicScenario-188834729 Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 1d9325e2d8c244a89bd64606ce752496 Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-TestMinimumBasicScenario-188834729 Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-TestMinimumBasicScenario-188834729-project Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: cb7aef18e7ca450b99f25928bb4e016c Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-TestMinimumBasicScenario-188834729-project Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b could not be found. Aug 23 16:56:19.690088 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '6d27d05d-835b-4e7b-ab51-cb7941c9f44b'} Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b could not be found. Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:56:19.691045 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b could not be found. Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b could not be found. Aug 23 16:56:19.692820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 16:56:19.694279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Returning 404 to user: Instance 6d27d05d-835b-4e7b-ab51-cb7941c9f44b could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:56:19.694279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4e4ab883-e8d9-4615-9fde-3359c790e39d tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b" status: 404 len: 111 microversion: 2.1 time: 0.030124 Aug 23 16:56:19.694279 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 626/1275] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:19 2022] GET /compute/v2.1/servers/6d27d05d-835b-4e7b-ab51-cb7941c9f44b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:56:19.699431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-66dfe06c-6803-4efe-b036-348aba997de7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] Calling method '.version_select at 0x7f677c94b0d0>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:19.703927 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR oslo.messaging._drivers.impl_rabbit [None req-66dfe06c-6803-4efe-b036-348aba997de7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [11cc7970-bb48-4915-a256-d9e6379c6505] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 16:56:20.711388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [None req-66dfe06c-6803-4efe-b036-348aba997de7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] [11cc7970-bb48-4915-a256-d9e6379c6505] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 55872. Aug 23 16:56:20.801346 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-66dfe06c-6803-4efe-b036-348aba997de7 tempest-TestMinimumBasicScenario-188834729 tempest-TestMinimumBasicScenario-188834729-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-546791381" status: 202 len: 0 microversion: 2.1 time: 1.105623 Aug 23 16:56:20.801931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 650/1276] 10.222.0.52 () {58 vars in 1269 bytes} [Tue Aug 23 16:56:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-546791381 => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:56:29.101510 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:29.102084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:29.103514 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-b62c8d4f-5ff1-4abb-8df5-6d6babdd19d6 req-5611b076-9b33-4ca4-a9f0-387b63193abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "823004bc-64c5-4d9c-872e-dc73ae7b49a3", "tag": "1f1d5f14-7a98-4e47-b015-c2247fabb0b8"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:56:29.109184 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:29.113658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:29.113658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:29.113658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:29.113658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:29.114084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:29.114184 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:29.116214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-b62c8d4f-5ff1-4abb-8df5-6d6babdd19d6 req-5611b076-9b33-4ca4-a9f0-387b63193abb service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:29.116765 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-b62c8d4f-5ff1-4abb-8df5-6d6babdd19d6 req-5611b076-9b33-4ca4-a9f0-387b63193abb service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:29.117266 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-b62c8d4f-5ff1-4abb-8df5-6d6babdd19d6 req-5611b076-9b33-4ca4-a9f0-387b63193abb service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:29.128992 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-b62c8d4f-5ff1-4abb-8df5-6d6babdd19d6 req-5611b076-9b33-4ca4-a9f0-387b63193abb service nova] Creating event network-changed:1f1d5f14-7a98-4e47-b015-c2247fabb0b8 for instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 on hv-cinder-85032 Aug 23 16:56:29.134438 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-b62c8d4f-5ff1-4abb-8df5-6d6babdd19d6 req-5611b076-9b33-4ca4-a9f0-387b63193abb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034233 Aug 23 16:56:29.135167 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 651/1277] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:56:29.141098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:56:29.505078 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b8566061-6659-41ff-bdd8-5d3d817b29ff tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "DELETE /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 204 len: 0 microversion: 2.1 time: 0.407106 Aug 23 16:56:29.506926 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 627/1278] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:56:29 2022] DELETE /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:56:29.516193 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:29.516919 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:29.523792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:29.524367 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:29.525015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:29.526159 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:29.526782 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:29.527392 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:29.709763 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:56:29.717774 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dda309a8-0521-4f12-afd6-5a4537d27746 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.206681 Aug 23 16:56:29.718337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 652/1279] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:29 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:56:30.740271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:30.740976 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:30.747347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:30.747849 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:30.748444 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:30.749129 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:30.749572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:30.749987 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:30.898174 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:56:30.906919 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-4c2d1d03-6626-4c08-8136-e7b3eae9cd9c tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1567 microversion: 2.1 time: 0.171440 Aug 23 16:56:30.907594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 628/1280] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:30 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:56:31.928214 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:31.928824 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:31.935478 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:31.936128 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:31.937011 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:31.937293 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:31.937408 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-ca203b7c-6032-4862-8e02-fd595c333217 req-14b287d2-20a6-4f30-8c30-b87e84c1e080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "823004bc-64c5-4d9c-872e-dc73ae7b49a3", "name": "network-vif-deleted", "tag": "1f1d5f14-7a98-4e47-b015-c2247fabb0b8"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:56:31.937911 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:31.938343 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:31.947770 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ca203b7c-6032-4862-8e02-fd595c333217 req-14b287d2-20a6-4f30-8c30-b87e84c1e080 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:31.950606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ca203b7c-6032-4862-8e02-fd595c333217 req-14b287d2-20a6-4f30-8c30-b87e84c1e080 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:31.950606 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ca203b7c-6032-4862-8e02-fd595c333217 req-14b287d2-20a6-4f30-8c30-b87e84c1e080 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:31.960306 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-ca203b7c-6032-4862-8e02-fd595c333217 req-14b287d2-20a6-4f30-8c30-b87e84c1e080 service nova] Creating event network-vif-deleted:1f1d5f14-7a98-4e47-b015-c2247fabb0b8 for instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 on hv-cinder-85032 Aug 23 16:56:31.965322 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-ca203b7c-6032-4862-8e02-fd595c333217 req-14b287d2-20a6-4f30-8c30-b87e84c1e080 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031602 Aug 23 16:56:31.965912 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 629/1281] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:56:32.003769 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:56:32.011794 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e3cc889d-9bd2-4e6c-8eba-9ac0f4c1f0be tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1383 microversion: 2.1 time: 0.087948 Aug 23 16:56:32.012398 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 653/1282] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:31 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1383 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:56:33.034173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:33.035050 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:33.042117 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:33.042635 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:33.043077 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:33.043857 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:33.044372 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:33.044830 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:33.074925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:33.075398 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:33.075830 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:33.076308 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lazy-loading 'fault' on Instance uuid 823004bc-64c5-4d9c-872e-dc73ae7b49a3 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 16:56:33.118030 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '866f33b28b714010a9807cd5a716939a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e40dd5c44be5454f9fbeefdd8ae7b45f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:56:33.125640 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-1dc14358-3cc7-4df9-abc1-eb1f7571e687 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 200 len: 1225 microversion: 2.1 time: 0.096239 Aug 23 16:56:33.126215 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 630/1283] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:33 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:56:34.146483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:34.147093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] [instance: 823004bc-64c5-4d9c-872e-dc73ae7b49a3] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:56:34.153383 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:34.153878 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:34.154310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:34.154987 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:56:34.155433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:56:34.155853 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:56:34.169244 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] HTTP exception thrown: Instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 could not be found. Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Request method failure captured: Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 HTTP/1.1 Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQVuI1raj1bfvP2TRhdNpaUpJy3efs52dLN_5AB9XBRxyn-rTg8lJheRM-u8sjqsLUUOqvjf4f2H7--OIIDAbomGheqZcu8taYHnb1-TDt87Bn178-X-fR59wk-U3hnggbnUrPPguRAqRc7dNEsPliNfbZu6W0FAdgSbFVlOS_HcpB8 Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: e40dd5c44be5454f9fbeefdd8ae7b45f Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-TestShelveInstance-361050935 Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 16:56:34.170829 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e40dd5c44be5454f9fbeefdd8ae7b45f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e40dd5c44be5454f9fbeefdd8ae7b45f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e40dd5c44be5454f9fbeefdd8ae7b45f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e40dd5c44be5454f9fbeefdd8ae7b45f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-TestShelveInstance-361050935 Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: e40dd5c44be5454f9fbeefdd8ae7b45f Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-TestShelveInstance-361050935 Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-TestShelveInstance-361050935-project Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 866f33b28b714010a9807cd5a716939a Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-TestShelveInstance-361050935-project Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 could not be found. Aug 23 16:56:34.172811 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '823004bc-64c5-4d9c-872e-dc73ae7b49a3'} Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 could not be found. Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 16:56:34.174034 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 could not be found. Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 could not be found. Aug 23 16:56:34.175846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 16:56:34.178159 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Returning 404 to user: Instance 823004bc-64c5-4d9c-872e-dc73ae7b49a3 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 16:56:34.178159 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-12e96921-0a0e-4970-b385-ca9471375968 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3" status: 404 len: 111 microversion: 2.1 time: 0.029592 Aug 23 16:56:34.178159 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 654/1284] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:56:34 2022] GET /compute/v2.1/servers/823004bc-64c5-4d9c-872e-dc73ae7b49a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 16:56:34.393079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-36638031-25b1-421e-983a-b30ae3b96a77 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] Calling method '.version_select at 0x7f67783114c0>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:56:34.463948 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-36638031-25b1-421e-983a-b30ae3b96a77 tempest-TestShelveInstance-361050935 tempest-TestShelveInstance-361050935-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1743212429" status: 202 len: 0 microversion: 2.1 time: 0.074639 Aug 23 16:56:34.464569 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 631/1285] 10.222.0.52 () {58 vars in 1254 bytes} [Tue Aug 23 16:56:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1743212429 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 16:56:55.091889 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:55.092384 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=16 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:56:55.258723 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dd35f9df-7992-485a-a40e-dbeb898bc3ad tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Action: 'create', calling method: .version_select at 0x7f67781d0700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1060161497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwbU103HketmJOCCu0l2mjuWjtR07/uCcunrdZbB12lzHUucWiiDAfz+IlWt1Nq/uWuNVQtPNVnWWqtOR9covbODh5DzBPkGTvIL6blYctf/DTi0tcG22TIhggzFEyB2Q=="}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:56:55.274884 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-dd35f9df-7992-485a-a40e-dbeb898bc3ad tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Getting quotas for project 466ef52107794f6a9b6cc8ce7ced20f7. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:56:55.278744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-dd35f9df-7992-485a-a40e-dbeb898bc3ad tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Getting quotas for user 68fb84a5e5514ef4a008e978d128ebaf and project 466ef52107794f6a9b6cc8ce7ced20f7. Resources: {'key_pairs'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:56:55.366069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dd35f9df-7992-485a-a40e-dbeb898bc3ad tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.279995 Aug 23 16:56:55.366668 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 655/1286] 10.222.0.52 () {60 vars in 1159 bytes} [Tue Aug 23 16:56:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:57:09.879582 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 16:57:09.880093 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 16:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 16:57:19.837170 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:57:19.844628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:57:19.844628 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1496931285", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1060161497", "security_groups": [{"name": "tempest-secgroup-smoke-1481865689"}], "block_device_mapping_v2": [{"uuid": "bc7df897-b5af-4907-bca9-47b0a6bfc799", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "56638449-95a3-4eb4-a5cc-c470afeb44d3"}]}} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:57:19.956489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.network.neutron [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] validate_networks() for [('56638449-95a3-4eb4-a5cc-c470afeb44d3', None, None, None, None, None)] {{(pid=133199) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 16:57:20.448503 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Flavor limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 16:57:20.448916 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Image limits 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 16:57:20.449381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Flavor pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 16:57:20.449782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Image pref 0:0:0 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 16:57:20.450185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.virt.hardware [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133199) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 16:57:20.458767 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:20.459232 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:20.459658 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:20.460401 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:20.460842 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:20.461253 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:20.477360 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Getting quotas for project 466ef52107794f6a9b6cc8ce7ced20f7. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 16:57:20.481296 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.quota [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Getting quotas for user 68fb84a5e5514ef4a008e978d128ebaf and project 466ef52107794f6a9b6cc8ce7ced20f7. Resources: {'ram', 'cores', 'instances'} {{(pid=133199) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 16:57:20.537288 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Going to run 1 instances... {{(pid=133199) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 16:57:20.539447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc7df897-b5af-4907-bca9-47b0a6bfc799',volume_size=None,volume_type=None)] {{(pid=133199) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 16:57:20.932983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-9c9f2e69-0ca4-403c-b034-326d6c193de8 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.097242 Aug 23 16:57:20.933668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 632/1287] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 16:57:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 16:57:20.942106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=4 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:57:20.942983 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:57:20.947017 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-85fc69c3-f35e-4c2b-98b1-c2f3001b4f2a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:20.948483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-85fc69c3-f35e-4c2b-98b1-c2f3001b4f2a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:21.007210 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-85fc69c3-f35e-4c2b-98b1-c2f3001b4f2a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:21.015219 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-85fc69c3-f35e-4c2b-98b1-c2f3001b4f2a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1095 microversion: 2.1 time: 0.074452 Aug 23 16:57:21.015779 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 656/1288] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:20 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:22.035459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-8901398f-c64a-4b04-a9f2-d5db0883fe70 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:22.036084 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-8901398f-c64a-4b04-a9f2-d5db0883fe70 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:22.089270 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-8901398f-c64a-4b04-a9f2-d5db0883fe70 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:22.096951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-8901398f-c64a-4b04-a9f2-d5db0883fe70 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1095 microversion: 2.1 time: 0.065884 Aug 23 16:57:22.097911 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 633/1289] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:22 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:23.117654 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:23.118381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:23.126419 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:23.126911 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:23.127477 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:23.128308 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:23.128768 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:23.129211 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:23.208142 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:23.215743 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-8e0f7f4a-8887-45d8-99eb-b083edd8e31f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1201 microversion: 2.1 time: 0.102174 Aug 23 16:57:23.216334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 657/1290] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:23 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1201 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:24.237355 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:24.237904 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:24.243896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:24.244430 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:24.244870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:24.245574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:24.246029 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:24.246458 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:24.405376 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:24.413213 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-aae57f2a-0e4d-45a6-ba55-fd93453a6504 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1279 microversion: 2.1 time: 0.180426 Aug 23 16:57:24.413777 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 634/1291] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:24 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1279 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:24.718205 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-0db2d1d7-c431-4f0e-acbf-1610f0b5f990 req-5bbc6338-7522-47b1-ab75-ad2779bee818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaaada4d-42af-4baa-9084-bcbca838a4d0", "tag": "5d1311ba-5698-42a4-b321-a5f47103ca7c"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:57:24.727635 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-0db2d1d7-c431-4f0e-acbf-1610f0b5f990 req-5bbc6338-7522-47b1-ab75-ad2779bee818 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:24.728277 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-0db2d1d7-c431-4f0e-acbf-1610f0b5f990 req-5bbc6338-7522-47b1-ab75-ad2779bee818 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:24.728703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-0db2d1d7-c431-4f0e-acbf-1610f0b5f990 req-5bbc6338-7522-47b1-ab75-ad2779bee818 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:24.740123 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-0db2d1d7-c431-4f0e-acbf-1610f0b5f990 req-5bbc6338-7522-47b1-ab75-ad2779bee818 service nova] Creating event network-changed:5d1311ba-5698-42a4-b321-a5f47103ca7c for instance aaaada4d-42af-4baa-9084-bcbca838a4d0 on hv-cinder-85032 Aug 23 16:57:24.745048 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-0db2d1d7-c431-4f0e-acbf-1610f0b5f990 req-5bbc6338-7522-47b1-ab75-ad2779bee818 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030509 Aug 23 16:57:24.745642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 658/1292] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:57:25.440425 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:25.441044 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:25.447358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:25.447840 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:25.448318 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:25.449016 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:25.449472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:25.449897 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:25.644865 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:25.652601 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-dcb402e6-716a-4115-b48f-b1158ad7651b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.216055 Aug 23 16:57:25.653173 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 635/1293] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:25 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:26.675000 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:26.675682 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:26.681759 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:26.682238 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:26.682699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:26.683368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:26.683823 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:26.684283 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:26.818686 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:26.826864 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-94d6e362-e153-4ea2-83ee-a12ab266164b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.155950 Aug 23 16:57:26.827422 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 659/1294] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:26 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:27.847451 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:27.848069 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:27.854605 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:27.855086 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:27.855543 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:27.856271 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:27.862281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:27.862281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:27.984291 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:27.991940 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-87c6fcb3-1aa6-428f-a285-fd42380784ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.148346 Aug 23 16:57:27.992542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 636/1295] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:27 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 16:57:29.012780 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:29.013407 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:29.020435 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:29.020923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:29.021363 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:29.022052 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:29.022510 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:29.022940 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:29.152698 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:29.160204 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e34f23de-ee25-471c-a1ec-e17fed7b471c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.151368 Aug 23 16:57:29.160757 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 660/1296] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:29 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:30.181181 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:30.181836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:30.188991 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:30.189472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:30.189960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:30.190953 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:30.191532 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:30.192142 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:30.321711 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:30.329418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-66237859-46b5-4197-b7c2-b840046d7fd6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.152209 Aug 23 16:57:30.329989 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 637/1297] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:30 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:31.351354 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:31.351933 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:31.354568 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:57:31.360540 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:31.361040 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:31.361484 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:31.362200 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:31.362659 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:31.363092 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:31.495941 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:31.503632 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-543dc596-043f-402b-ae35-8e35ebec5ca0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.156436 Aug 23 16:57:31.504359 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 661/1298] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:31 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:32.524383 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:32.524999 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:32.526860 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:57:32.528065 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=8 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:57:32.533312 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:32.536918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:32.536918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:32.536918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:32.536918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:32.537387 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:32.669553 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:32.678250 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3744b663-23b4-4564-ad8a-9b089f5e4d97 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.157778 Aug 23 16:57:32.678827 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 638/1299] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:32 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:33.698905 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:33.699521 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:33.705957 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:33.706444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:33.706890 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:33.707583 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:33.708042 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:33.708499 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:33.837967 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:33.845894 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-f28ff722-fd0a-429e-b0e2-93ee972c3ba5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.150797 Aug 23 16:57:33.846452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 662/1300] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:33 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:34.867491 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:34.868106 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:34.875162 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:34.875638 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:34.876112 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:34.876829 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:34.877275 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:34.877693 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:35.011460 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:35.019828 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-876a4b10-5d0d-4acf-ad35-f9433d3b7c81 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.156351 Aug 23 16:57:35.020416 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 639/1301] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:34 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:36.040669 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:36.041287 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:36.047661 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:36.048146 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:36.048613 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:36.049304 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:36.049764 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:36.050192 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:36.177492 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:36.184982 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-d8a4c215-82de-499b-9f15-693c1f7cb899 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.148192 Aug 23 16:57:36.185536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 663/1302] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:36 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:36.751594 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-496d7609-ebfd-4d05-81c8-27807ebd7c6c req-24f701ba-6257-49b0-bad7-e7efde527590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaaada4d-42af-4baa-9084-bcbca838a4d0", "name": "network-vif-plugged", "status": "completed", "tag": "5d1311ba-5698-42a4-b321-a5f47103ca7c"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:57:36.761431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-496d7609-ebfd-4d05-81c8-27807ebd7c6c req-24f701ba-6257-49b0-bad7-e7efde527590 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:36.761431 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-496d7609-ebfd-4d05-81c8-27807ebd7c6c req-24f701ba-6257-49b0-bad7-e7efde527590 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:36.761747 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-496d7609-ebfd-4d05-81c8-27807ebd7c6c req-24f701ba-6257-49b0-bad7-e7efde527590 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:36.772713 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-496d7609-ebfd-4d05-81c8-27807ebd7c6c req-24f701ba-6257-49b0-bad7-e7efde527590 service nova] Creating event network-vif-plugged:5d1311ba-5698-42a4-b321-a5f47103ca7c for instance aaaada4d-42af-4baa-9084-bcbca838a4d0 on hv-cinder-85032 Aug 23 16:57:36.777770 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-496d7609-ebfd-4d05-81c8-27807ebd7c6c req-24f701ba-6257-49b0-bad7-e7efde527590 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089297 Aug 23 16:57:36.778372 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 640/1303] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:57:37.205203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:37.205814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:37.212111 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:37.212624 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:37.213059 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:37.213743 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:37.214195 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:37.214621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:37.342182 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:37.350239 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-7fd3938d-0dc3-487d-932d-5ecd921ef599 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.148884 Aug 23 16:57:37.350832 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 664/1304] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:37 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:38.371836 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:38.372560 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:38.378719 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:38.379205 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:38.379643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:38.380360 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:38.380816 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:38.381250 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:38.517949 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:38.525488 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-11d8f4d0-cdee-4b68-b2d3-d6d713815340 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1267 microversion: 2.1 time: 0.158374 Aug 23 16:57:38.526047 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 641/1305] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:38 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:39.545859 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:39.546475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:39.553470 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:39.553958 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:39.554399 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:39.555108 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:39.555549 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:39.555979 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:39.690337 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:39.698000 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-e2ed4735-c96a-41e2-9372-8fd46cb9f62b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1454 microversion: 2.1 time: 0.155992 Aug 23 16:57:39.698563 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 665/1306] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:39 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:39.717864 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:57:39.718475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:57:39.724977 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:39.725457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:39.725888 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:39.726569 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:39.727015 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:39.727436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:39.855246 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:57:39.863668 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-bcff8665-4cf7-42ff-b450-debcfd1898b5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1454 microversion: 2.1 time: 0.149625 Aug 23 16:57:39.864259 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 642/1307] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:57:39 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:57:41.752449 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-591bc7ed-23af-485c-b8e4-8e071dc4785f req-4e58a71b-52a7-4fe3-a783-7470072678db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaaada4d-42af-4baa-9084-bcbca838a4d0", "tag": "5d1311ba-5698-42a4-b321-a5f47103ca7c"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:57:41.762296 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-591bc7ed-23af-485c-b8e4-8e071dc4785f req-4e58a71b-52a7-4fe3-a783-7470072678db service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:57:41.762767 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-591bc7ed-23af-485c-b8e4-8e071dc4785f req-4e58a71b-52a7-4fe3-a783-7470072678db service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:57:41.763199 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-591bc7ed-23af-485c-b8e4-8e071dc4785f req-4e58a71b-52a7-4fe3-a783-7470072678db service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:57:41.778817 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-591bc7ed-23af-485c-b8e4-8e071dc4785f req-4e58a71b-52a7-4fe3-a783-7470072678db service nova] Creating event network-changed:5d1311ba-5698-42a4-b321-a5f47103ca7c for instance aaaada4d-42af-4baa-9084-bcbca838a4d0 on hv-cinder-85032 Aug 23 16:57:41.779581 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-591bc7ed-23af-485c-b8e4-8e071dc4785f req-4e58a71b-52a7-4fe3-a783-7470072678db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031410 Aug 23 16:57:41.780213 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 666/1308] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 16:58:52.319521 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 16:58:52.320154 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Tue Aug 23 16:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 16:59:55.375475 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36fb6917-ad57-40db-b18b-c928804d1fe7] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 16:59:55.376298 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:59:55.377107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=52 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:59:55.380920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:59:55.381410 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:59:55.387083 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:55.392053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:55.392053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:55.392053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:55.392053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:55.392462 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:55.414643 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Going to try to terminate instance {{(pid=133199) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 16:59:55.766630 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-209e9018-bda1-4d8b-983d-6b83c376451d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 204 len: 0 microversion: 2.1 time: 0.392805 Aug 23 16:59:55.767204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 643/1309] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 16:59:55 2022] DELETE /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 16:59:55.773446 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9fe47e77-1fc4-4d0b-b842-039921858b0f] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 16:59:55.776652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=24 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:59:55.776652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=52 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 16:59:55.779267 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:59:55.779962 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:59:55.786032 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:55.786514 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:55.786951 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:55.787644 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:55.788212 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:55.788651 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:55.997624 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:59:56.005870 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1fbf8f09-bbfe-47c9-837e-5c2aa0df4f7b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1577 microversion: 2.1 time: 0.234203 Aug 23 16:59:56.006427 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 667/1310] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:59:55 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:59:57.029484 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:59:57.030175 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:59:57.039430 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:57.039913 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:57.040382 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:57.041079 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:57.041556 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:57.041978 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:57.047406 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] [36fb6917-ad57-40db-b18b-c928804d1fe7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56330. Aug 23 16:59:57.226267 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:59:57.234186 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-eeef3ef7-994b-4160-9254-8a7013374f36 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1577 microversion: 2.1 time: 0.208694 Aug 23 16:59:57.234757 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 644/1311] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:59:57 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1577 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:59:58.257915 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:59:58.258838 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:59:58.265478 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:58.265978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:58.266336 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:58.267667 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:58.268127 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:58.268576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:58.287979 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] [9fe47e77-1fc4-4d0b-b842-039921858b0f] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56338. Aug 23 16:59:58.472437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:59:58.480343 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-eb83feae-eb29-4ade-a71a-376eaf0c6dc3 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1577 microversion: 2.1 time: 0.229257 Aug 23 16:59:58.480903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 668/1312] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:59:58 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 16:59:59.206201 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-3ef2d918-0be0-47a6-8ede-f61d7155bf6c req-376827fb-3b90-45fe-9855-f6b521a919ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaaada4d-42af-4baa-9084-bcbca838a4d0", "name": "network-vif-deleted", "tag": "5d1311ba-5698-42a4-b321-a5f47103ca7c"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 16:59:59.216066 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-3ef2d918-0be0-47a6-8ede-f61d7155bf6c req-376827fb-3b90-45fe-9855-f6b521a919ba service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:59.216571 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-3ef2d918-0be0-47a6-8ede-f61d7155bf6c req-376827fb-3b90-45fe-9855-f6b521a919ba service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:59.217002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-3ef2d918-0be0-47a6-8ede-f61d7155bf6c req-376827fb-3b90-45fe-9855-f6b521a919ba service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:59.228105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-3ef2d918-0be0-47a6-8ede-f61d7155bf6c req-376827fb-3b90-45fe-9855-f6b521a919ba service nova] Creating event network-vif-deleted:5d1311ba-5698-42a4-b321-a5f47103ca7c for instance aaaada4d-42af-4baa-9084-bcbca838a4d0 on hv-cinder-85032 Aug 23 16:59:59.233093 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-3ef2d918-0be0-47a6-8ede-f61d7155bf6c req-376827fb-3b90-45fe-9855-f6b521a919ba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031159 Aug 23 16:59:59.233680 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 645/1313] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 16:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 16:59:59.503071 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 16:59:59.503684 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 16:59:59.510005 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:59.510486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:59.510923 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:59.511619 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 16:59:59.512069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 16:59:59.512524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 16:59:59.574421 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 16:59:59.582010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5cc66eac-e24d-441a-b6c2-25e49cba3158 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 200 len: 1226 microversion: 2.1 time: 0.083369 Aug 23 16:59:59.582929 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 669/1314] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 16:59:59 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:00.603309 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:00.603965 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:00.610517 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:00.618018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:00.618018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:00.618018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:00.618018 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:00.618478 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:00.630327 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] HTTP exception thrown: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Request method failure captured: Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 HTTP/1.1 Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQbRuNrkpmxSrmMye6rXa-h4jzxe5FgB0K0iMta60oX3cSQq-Sruk8LZ3aTJPlBo_-uj3ekJKX-LTEyaf__GVb0_Vw0kmeiZ_FtMqXThW36B2XptRWza6R3hijn3D8A3WAbwZ4Exv5oRQjEyb7x8A8NNPX5bmS6w2ADPpp1GwMpA7N0 Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 17:00:00.631954 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_466ef52107794f6a9b6cc8ce7ced20f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 68fb84a5e5514ef4a008e978d128ebaf Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:00:00.634007 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': 'aaaada4d-42af-4baa-9084-bcbca838a4d0'} Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:00:00.635089 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:00:00.641568 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:00:00.643609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Returning 404 to user: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:00:00.643609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-cd04354e-d232-4a98-8a50-823efd1d11f5 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 404 len: 111 microversion: 2.1 time: 0.035007 Aug 23 17:00:00.643609 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 646/1315] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:00 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:00:00.687649 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-895247947", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1060161497", "security_groups": [{"name": "tempest-secgroup-smoke-1481865689"}], "block_device_mapping_v2": [{"uuid": "bc7df897-b5af-4907-bca9-47b0a6bfc799", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "56638449-95a3-4eb4-a5cc-c470afeb44d3"}]}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:00:00.798951 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] validate_networks() for [('56638449-95a3-4eb4-a5cc-c470afeb44d3', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:00:01.197942 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:00:01.198376 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:00:01.198850 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:00:01.199258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:00:01.199671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:00:01.208813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:01.209292 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:01.209728 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:01.210450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:01.210904 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:01.211330 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:01.228593 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Getting quotas for project 466ef52107794f6a9b6cc8ce7ced20f7. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:00:01.232655 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Getting quotas for user 68fb84a5e5514ef4a008e978d128ebaf and project 466ef52107794f6a9b6cc8ce7ced20f7. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:00:01.289961 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:00:01.292133 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc7df897-b5af-4907-bca9-47b0a6bfc799',volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:00:01.775828 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9115205f-5880-43c3-9a10-e87f50a17c53 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.092227 Aug 23 17:00:01.776879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 670/1316] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 17:00:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:00:01.787470 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-62ea2eb9-b163-47ef-bbb3-b7b7f36a4e84 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:01.788076 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-62ea2eb9-b163-47ef-bbb3-b7b7f36a4e84 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:01.842281 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-62ea2eb9-b163-47ef-bbb3-b7b7f36a4e84 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:01.848941 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-62ea2eb9-b163-47ef-bbb3-b7b7f36a4e84 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1094 microversion: 2.1 time: 0.065339 Aug 23 17:00:01.849615 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 647/1317] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:01 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:02.870022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:02.870695 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:02.877182 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:02.883381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:02.883381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:02.883381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:02.883381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:02.883896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:02.944090 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:02.951742 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-63a6c086-55e4-4e3b-bce3-29ef2dc8343d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1144 microversion: 2.1 time: 0.085759 Aug 23 17:00:02.952325 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 671/1318] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:02 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:03.972146 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:03.972732 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:03.979896 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:03.980439 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:03.980879 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:03.981569 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:03.982024 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:03.982450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:04.043204 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:04.051347 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-d86bcdf5-05d6-4b75-bc6e-0d6394ee0aac tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1192 microversion: 2.1 time: 0.083174 Aug 23 17:00:04.051942 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 648/1319] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:03 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:00:05.079086 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:05.080286 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:05.086879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:05.087368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:05.087840 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:05.088628 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:05.089082 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:05.089512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:05.263416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:05.270675 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-14f4b797-8ac0-4f3c-8ad2-f179fb3cbf91 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1278 microversion: 2.1 time: 0.195572 Aug 23 17:00:05.271250 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 672/1320] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:05 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1278 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:06.006127 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-18a680d7-e8b6-4bed-92da-d3f3dfcd10a8 req-b914750e-64c2-4d40-ba76-9e6b9296ef4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b05fee-0492-49c9-9201-68f5a0b9e719", "tag": "e9b048ae-caeb-4527-861e-ace275773ea4"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:00:06.016158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-18a680d7-e8b6-4bed-92da-d3f3dfcd10a8 req-b914750e-64c2-4d40-ba76-9e6b9296ef4d service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:06.017289 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-18a680d7-e8b6-4bed-92da-d3f3dfcd10a8 req-b914750e-64c2-4d40-ba76-9e6b9296ef4d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:06.017729 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-18a680d7-e8b6-4bed-92da-d3f3dfcd10a8 req-b914750e-64c2-4d40-ba76-9e6b9296ef4d service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:06.028946 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-18a680d7-e8b6-4bed-92da-d3f3dfcd10a8 req-b914750e-64c2-4d40-ba76-9e6b9296ef4d service nova] Creating event network-changed:e9b048ae-caeb-4527-861e-ace275773ea4 for instance 38b05fee-0492-49c9-9201-68f5a0b9e719 on hv-cinder-85032 Aug 23 17:00:06.033920 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-18a680d7-e8b6-4bed-92da-d3f3dfcd10a8 req-b914750e-64c2-4d40-ba76-9e6b9296ef4d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031493 Aug 23 17:00:06.034522 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 649/1321] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:00:06.294083 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:06.294727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:06.301819 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:06.302310 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:06.302754 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:06.303476 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:06.303955 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:06.304416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:06.463813 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:06.472311 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-b00dbc84-a964-45de-a36a-d25f01e3a508 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.182204 Aug 23 17:00:06.480985 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 673/1322] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:06 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:07.495410 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:07.496108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:07.502742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:07.503222 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:07.503666 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:07.504474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:07.504918 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:07.505343 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:07.637742 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:07.645501 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ea4d1c72-9642-43f5-963f-0a12a3d1524f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.154874 Aug 23 17:00:07.646063 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 650/1323] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:07 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:08.665814 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:08.666464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:08.672969 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:08.673453 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:08.673892 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:08.674584 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:08.675067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:08.675497 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:08.803931 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:08.811495 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9bd2b92e-e4e7-4845-8e5e-a7ca5ee4fa6e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.149501 Aug 23 17:00:08.812050 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 674/1324] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:08 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:09.833221 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:09.833832 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:09.840338 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:09.840820 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:09.841255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:09.842028 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:09.842507 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:09.843002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:09.972994 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:09.980906 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-dc419e3f-a329-41be-9ab7-87ae3e367046 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.152258 Aug 23 17:00:09.981474 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 651/1325] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:09 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:11.001458 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:11.002082 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:11.009148 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:11.009706 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:11.010221 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:11.011023 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:11.011480 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:11.011910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:11.142113 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:11.150621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ab2ef174-d59f-41e6-ad3c-bc8e6352f94c tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.153118 Aug 23 17:00:11.151185 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 675/1326] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:10 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:12.171056 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:12.171599 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:12.174060 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:00:12.179025 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:12.179539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:12.179974 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:12.180687 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:12.181145 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:12.181572 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:12.310495 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:12.318039 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-32447024-731a-464f-a172-217f9a3d8464 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.150974 Aug 23 17:00:12.322798 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 652/1327] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:12 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:13.337936 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:13.338810 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:13.340708 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:00:13.341361 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=6 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:00:13.346531 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:13.347003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:13.347432 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:13.348112 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:13.348589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:13.349044 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:13.481666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:13.489922 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9422cb77-2c1c-40b1-87d2-64b4430cdebb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.155818 Aug 23 17:00:13.490483 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 676/1328] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:13 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:00:14.510472 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:14.511090 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:14.517611 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:14.518113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:14.518574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:14.519263 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:14.519714 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:14.520184 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:14.648737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:14.656384 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6a5e4745-e5a9-4a57-9f5d-d18513faffb2 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.149865 Aug 23 17:00:14.656951 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 653/1329] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:14 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:15.676721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:15.677371 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:15.684021 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:15.684537 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:15.684978 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:15.685676 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:15.686134 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:15.686646 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:15.820589 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:15.828129 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-6eada8b8-327b-4228-aaa7-65616458456a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.155523 Aug 23 17:00:15.828717 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 677/1330] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:15 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:16.849177 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:16.849817 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:16.856252 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:16.856731 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:16.857168 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:16.857849 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:16.858294 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:16.858709 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:16.990696 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:16.998352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a02126aa-1c16-43b7-9d06-106d67c5edcd tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.153046 Aug 23 17:00:16.998913 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 654/1331] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:16 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:17.546962 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-698a373c-c5ac-47f8-ae85-bdd988a813ab req-07630f9e-7971-46c2-b1d6-1bf3212cb506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b05fee-0492-49c9-9201-68f5a0b9e719", "name": "network-vif-plugged", "status": "completed", "tag": "e9b048ae-caeb-4527-861e-ace275773ea4"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:00:17.556899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-698a373c-c5ac-47f8-ae85-bdd988a813ab req-07630f9e-7971-46c2-b1d6-1bf3212cb506 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:17.557381 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-698a373c-c5ac-47f8-ae85-bdd988a813ab req-07630f9e-7971-46c2-b1d6-1bf3212cb506 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:17.557865 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-698a373c-c5ac-47f8-ae85-bdd988a813ab req-07630f9e-7971-46c2-b1d6-1bf3212cb506 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:17.568436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-698a373c-c5ac-47f8-ae85-bdd988a813ab req-07630f9e-7971-46c2-b1d6-1bf3212cb506 service nova] Creating event network-vif-plugged:e9b048ae-caeb-4527-861e-ace275773ea4 for instance 38b05fee-0492-49c9-9201-68f5a0b9e719 on hv-cinder-85032 Aug 23 17:00:17.571827 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR oslo.messaging._drivers.impl_rabbit [req-698a373c-c5ac-47f8-ae85-bdd988a813ab req-07630f9e-7971-46c2-b1d6-1bf3212cb506 service nova] [fccec11e-3cca-4450-a24d-8305e4b0f1c8] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 17:00:18.018708 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:18.019320 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:18.026310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:18.026788 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:18.027220 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:18.027908 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:18.028386 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:18.028809 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:18.161094 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:18.169098 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b4511aac-fa4e-401e-a96f-7a30fa179710 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.154243 Aug 23 17:00:18.169665 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 655/1332] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:18 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:00:18.578700 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [req-698a373c-c5ac-47f8-ae85-bdd988a813ab req-07630f9e-7971-46c2-b1d6-1bf3212cb506 service nova] [fccec11e-3cca-4450-a24d-8305e4b0f1c8] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56408. Aug 23 17:00:18.582124 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-698a373c-c5ac-47f8-ae85-bdd988a813ab req-07630f9e-7971-46c2-b1d6-1bf3212cb506 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.039026 Aug 23 17:00:18.582762 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 678/1333] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:00:19.190745 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:19.191287 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:19.198457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:19.198937 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:19.199390 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:19.200062 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:19.200539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:19.200960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:19.328482 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:19.336889 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-6d81ce08-36d4-404f-a386-7aad8b097af6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.150210 Aug 23 17:00:19.337457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 656/1334] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:19 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:20.357920 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:20.358620 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:20.365206 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:20.365691 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:20.366134 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:20.366835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:20.367285 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:20.367712 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:20.505910 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:20.513737 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2f74a936-7f9f-4619-a616-3354db71d019 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1266 microversion: 2.1 time: 0.160659 Aug 23 17:00:20.514335 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 679/1335] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:20 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:21.534740 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:21.535974 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:21.542420 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:21.542900 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:21.543336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:21.544035 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:21.544516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:21.544943 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:21.676616 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:21.684325 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-612acd6e-07c7-4928-bb0a-d66df92dcc04 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1452 microversion: 2.1 time: 0.153462 Aug 23 17:00:21.684887 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 657/1336] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:21 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:21.703887 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:00:21.704524 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:00:21.710818 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:21.711299 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:21.711734 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:21.712486 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:21.712943 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:21.713368 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:21.839410 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:00:21.847116 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2f2e198d-bd52-4ccc-9ad8-a2f45e72253e tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1452 microversion: 2.1 time: 0.146994 Aug 23 17:00:21.848308 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 680/1337] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:00:21 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:00:24.005952 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-7c43bf1e-2be2-468d-a140-46f2db7f6f81 req-c8e17bd8-ccf6-44e8-8c80-e2659a3c7c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b05fee-0492-49c9-9201-68f5a0b9e719", "tag": "e9b048ae-caeb-4527-861e-ace275773ea4"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:00:24.015839 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-7c43bf1e-2be2-468d-a140-46f2db7f6f81 req-c8e17bd8-ccf6-44e8-8c80-e2659a3c7c84 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:00:24.016352 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-7c43bf1e-2be2-468d-a140-46f2db7f6f81 req-c8e17bd8-ccf6-44e8-8c80-e2659a3c7c84 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:00:24.016784 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-7c43bf1e-2be2-468d-a140-46f2db7f6f81 req-c8e17bd8-ccf6-44e8-8c80-e2659a3c7c84 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:00:24.028111 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-7c43bf1e-2be2-468d-a140-46f2db7f6f81 req-c8e17bd8-ccf6-44e8-8c80-e2659a3c7c84 service nova] Creating event network-changed:e9b048ae-caeb-4527-861e-ace275773ea4 for instance 38b05fee-0492-49c9-9201-68f5a0b9e719 on hv-cinder-85032 Aug 23 17:00:24.033169 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-7c43bf1e-2be2-468d-a140-46f2db7f6f81 req-c8e17bd8-ccf6-44e8-8c80-e2659a3c7c84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031460 Aug 23 17:00:24.033769 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 658/1338] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:00:29.887888 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:00:29.888450 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 17:00:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:02:03.114167 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:02:03.114750 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Tue Aug 23 17:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:02:10.230597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:02:10.231112 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 17:02:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:02:24.186200 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:02:24.186964 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=76 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:02:24.191010 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-530642658", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1060161497", "security_groups": [{"name": "tempest-secgroup-smoke-1481865689"}], "block_device_mapping_v2": [{"uuid": "327817ef-658b-45ca-acc9-266207709c47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "56638449-95a3-4eb4-a5cc-c470afeb44d3"}]}} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:02:24.304761 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.network.neutron [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] validate_networks() for [('56638449-95a3-4eb4-a5cc-c470afeb44d3', None, None, None, None, None)] {{(pid=133198) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:02:24.669695 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Flavor limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:02:24.670116 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Image limits 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:02:24.670590 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Flavor pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:02:24.670993 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Image pref 0:0:0 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:02:24.671402 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.virt.hardware [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133198) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:02:24.680093 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:24.680605 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:24.681040 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:24.681789 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:24.682243 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:24.682671 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:24.699493 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Getting quotas for project 466ef52107794f6a9b6cc8ce7ced20f7. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:02:24.704012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.quota [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Getting quotas for user 68fb84a5e5514ef4a008e978d128ebaf and project 466ef52107794f6a9b6cc8ce7ced20f7. Resources: {'ram', 'cores', 'instances'} {{(pid=133198) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:02:24.759546 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Going to run 1 instances... {{(pid=133198) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:02:24.761649 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='327817ef-658b-45ca-acc9-266207709c47',volume_size=None,volume_type=None)] {{(pid=133198) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:02:25.238067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-519f5031-d615-48c1-a624-0d92a8e30636 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.053490 Aug 23 17:02:25.239088 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 681/1339] 10.222.0.52 () {60 vars in 1147 bytes} [Tue Aug 23 17:02:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:02:25.248072 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR oslo.messaging._drivers.impl_rabbit [-] [36fb6917-ad57-40db-b18b-c928804d1fe7] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 17:02:25.249570 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:02:25.250336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:02:25.254647 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-3b58f867-1605-4c6d-a1cb-da8ac5e48ee0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:25.255408 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-3b58f867-1605-4c6d-a1cb-da8ac5e48ee0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:25.311662 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-3b58f867-1605-4c6d-a1cb-da8ac5e48ee0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:25.318617 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-3b58f867-1605-4c6d-a1cb-da8ac5e48ee0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1094 microversion: 2.1 time: 0.072546 Aug 23 17:02:25.319164 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 659/1340] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:25 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:26.338372 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:26.338998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:26.345574 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:26.346055 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:26.349094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:26.349094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:26.349094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:26.349094 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:26.411843 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:26.420416 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-33dccade-799b-4e82-90a2-66e97bbbecee tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1144 microversion: 2.1 time: 0.085956 Aug 23 17:02:26.421475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 682/1341] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:26 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:27.441870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:27.442493 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:27.454255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:27.457185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:27.457185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:27.457185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:27.457185 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:27.457597 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:27.462479 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] [36fb6917-ad57-40db-b18b-c928804d1fe7] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 56544. Aug 23 17:02:27.527150 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:27.530709 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-93a7667b-cfc6-4fd7-a4c5-9d2395c6ea3f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1210 microversion: 2.1 time: 0.093236 Aug 23 17:02:27.531574 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 660/1342] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:27 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:28.551518 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:28.552388 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:28.558265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:28.558703 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:28.559187 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:28.559822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:28.560306 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:28.560736 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:28.764246 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:28.771908 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-64804a36-a77d-47a5-9ba9-6afa77237513 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1278 microversion: 2.1 time: 0.224959 Aug 23 17:02:28.772578 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 683/1343] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:28 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:28.979946 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-97d64884-bf01-4f99-ab2a-94c74650cc7d req-b2b10ce6-5066-4265-9931-ad47e0bc057c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ede4e6b-e5af-4ca9-8b10-275d4819818b", "tag": "c54d7558-ae94-4078-8e1a-711090d12c74"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:02:28.989961 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-97d64884-bf01-4f99-ab2a-94c74650cc7d req-b2b10ce6-5066-4265-9931-ad47e0bc057c service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:28.990424 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-97d64884-bf01-4f99-ab2a-94c74650cc7d req-b2b10ce6-5066-4265-9931-ad47e0bc057c service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:28.990844 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-97d64884-bf01-4f99-ab2a-94c74650cc7d req-b2b10ce6-5066-4265-9931-ad47e0bc057c service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:29.001664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-97d64884-bf01-4f99-ab2a-94c74650cc7d req-b2b10ce6-5066-4265-9931-ad47e0bc057c service nova] Creating event network-changed:c54d7558-ae94-4078-8e1a-711090d12c74 for instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b on hv-cinder-85032 Aug 23 17:02:29.006468 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-97d64884-bf01-4f99-ab2a-94c74650cc7d req-b2b10ce6-5066-4265-9931-ad47e0bc057c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089279 Aug 23 17:02:29.007212 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 661/1344] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:02:29.792489 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:29.793119 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:29.799903 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:29.800415 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:29.800847 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:29.801527 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:29.801973 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:29.802395 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:29.934328 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:29.941916 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-81a2124c-a3c4-46e7-98fc-1ca0d897762d tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.153260 Aug 23 17:02:29.942498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 684/1345] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:29 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:30.963523 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:30.964248 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:30.970489 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:30.970973 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:30.971411 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:30.972096 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:30.972589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:30.973015 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:31.106424 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:31.114847 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c8132ff2-f0a4-43d6-bf32-293247981a11 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.156010 Aug 23 17:02:31.115415 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 662/1346] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:30 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:32.135172 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:32.135775 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:32.142822 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:32.143304 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:32.143746 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:32.144464 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:32.144918 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:32.145346 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:32.274427 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:32.281984 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-28309953-c83e-4e9c-8148-6bb90794994f tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.150609 Aug 23 17:02:32.282536 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 685/1347] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:32 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:33.302712 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:33.303326 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:33.309864 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:33.310345 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:33.310824 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:33.311516 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:33.312580 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:33.313024 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:33.442938 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:33.450610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5a36c719-9ba3-4f97-a49b-eaf9036cb889 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.151783 Aug 23 17:02:33.451171 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 663/1348] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:33 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:02:34.470836 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:34.471437 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:34.477737 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:34.478212 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:34.478672 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:34.479347 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:34.479792 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:34.480232 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:34.605692 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:34.613970 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-a344a4de-bdb3-48b1-9acd-98c8c62d7559 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.146974 Aug 23 17:02:34.614523 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 686/1349] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:34 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:35.634466 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:35.635012 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:35.637464 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell0:SELECT=2 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:02:35.642840 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:35.646140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:35.646140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:35.646140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:35.646140 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:35.646542 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:35.775858 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:35.783451 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-55f96e6d-02ca-4198-9076-5b6dd9ad88aa tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.152927 Aug 23 17:02:35.784020 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 664/1350] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:35 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:36.803403 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:36.804015 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:36.805876 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=2 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:02:36.806576 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell0:SELECT=6 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:02:36.811781 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:36.812414 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:36.812860 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:36.813555 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:36.814012 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:36.814441 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:36.942452 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:36.949939 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9372de0b-ef88-404d-a466-5ca984f9a178 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.150452 Aug 23 17:02:36.950491 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 687/1351] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:36 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:37.971158 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:37.971775 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:37.978255 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:37.978737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:37.979172 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:37.979860 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:37.980349 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:37.980778 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:38.108508 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:38.117003 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-29fdf257-c7cd-4048-9865-704812323b72 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.150213 Aug 23 17:02:38.119030 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 665/1352] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:37 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:39.137184 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:39.137790 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:39.144457 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:39.144891 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:39.145342 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:39.146016 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:39.146470 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:39.146896 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:39.278629 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:39.286109 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-2ff5d800-1518-45f4-8506-fb99cab7b5e7 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.152796 Aug 23 17:02:39.286670 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 688/1353] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:39 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:02:40.287426 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-33652bc3-89ca-4305-961b-5bf0e1a77733 req-d28158e6-59bd-4b27-b9bb-7f42b3f4d905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ede4e6b-e5af-4ca9-8b10-275d4819818b", "name": "network-vif-plugged", "status": "completed", "tag": "c54d7558-ae94-4078-8e1a-711090d12c74"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:02:40.291950 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-33652bc3-89ca-4305-961b-5bf0e1a77733 req-d28158e6-59bd-4b27-b9bb-7f42b3f4d905 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:40.292451 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-33652bc3-89ca-4305-961b-5bf0e1a77733 req-d28158e6-59bd-4b27-b9bb-7f42b3f4d905 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:40.292870 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-33652bc3-89ca-4305-961b-5bf0e1a77733 req-d28158e6-59bd-4b27-b9bb-7f42b3f4d905 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:40.303737 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-33652bc3-89ca-4305-961b-5bf0e1a77733 req-d28158e6-59bd-4b27-b9bb-7f42b3f4d905 service nova] Creating event network-vif-plugged:c54d7558-ae94-4078-8e1a-711090d12c74 for instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b on hv-cinder-85032 Aug 23 17:02:40.307074 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:40.307831 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:40.308983 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-33652bc3-89ca-4305-961b-5bf0e1a77733 req-d28158e6-59bd-4b27-b9bb-7f42b3f4d905 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079350 Aug 23 17:02:40.309729 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 666/1354] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:02:40.314906 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:40.316233 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:40.316233 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:40.316632 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:40.317095 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:40.317525 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:40.449106 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:40.457433 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-5348081f-6953-42e1-8d16-b3b6a2172563 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.154314 Aug 23 17:02:40.458003 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 689/1355] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:40 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:41.478497 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:41.479224 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:41.485633 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:41.486107 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:41.486539 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:41.487221 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:41.487671 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:41.488093 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:41.617069 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:41.625245 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-a157256c-5c81-4269-a3ef-640b6db6aac4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.151417 Aug 23 17:02:41.625845 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 667/1356] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:41 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:42.645694 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:42.646621 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:42.652770 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:42.653256 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:42.653693 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:42.654450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:42.654909 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:42.655844 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:42.785447 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:42.793047 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-ff44b6c0-1826-42de-9b5e-917dd7143ddb tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1266 microversion: 2.1 time: 0.151255 Aug 23 17:02:42.793606 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 690/1357] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:42 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:43.814109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:43.814718 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:43.821175 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:43.821657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:43.822092 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:43.822782 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:43.823233 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:43.823657 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:43.958310 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:43.966049 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b67efdee-ee58-4455-b82b-3f590def7d29 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1452 microversion: 2.1 time: 0.156508 Aug 23 17:02:43.966610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 668/1358] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:43 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:43.986948 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:02:43.987681 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:02:43.994129 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:43.997899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:43.997899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:43.997899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:43.997899 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:43.998374 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:44.129287 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:02:44.136900 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-19341326-0112-466b-942c-bb89f712192a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1452 microversion: 2.1 time: 0.154700 Aug 23 17:02:44.137459 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 691/1359] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:02:43 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:02:46.310237 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-ec5072be-ccec-4ebe-875a-61f5db5ee358 req-986b56bd-4f78-4b7b-8549-44bbeaa80c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ede4e6b-e5af-4ca9-8b10-275d4819818b", "tag": "c54d7558-ae94-4078-8e1a-711090d12c74"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:02:46.320138 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ec5072be-ccec-4ebe-875a-61f5db5ee358 req-986b56bd-4f78-4b7b-8549-44bbeaa80c05 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:02:46.320678 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ec5072be-ccec-4ebe-875a-61f5db5ee358 req-986b56bd-4f78-4b7b-8549-44bbeaa80c05 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:02:46.321109 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-ec5072be-ccec-4ebe-875a-61f5db5ee358 req-986b56bd-4f78-4b7b-8549-44bbeaa80c05 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:02:46.332483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-ec5072be-ccec-4ebe-875a-61f5db5ee358 req-986b56bd-4f78-4b7b-8549-44bbeaa80c05 service nova] Creating event network-changed:c54d7558-ae94-4078-8e1a-711090d12c74 for instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b on hv-cinder-85032 Aug 23 17:02:46.337925 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-ec5072be-ccec-4ebe-875a-61f5db5ee358 req-986b56bd-4f78-4b7b-8549-44bbeaa80c05 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031811 Aug 23 17:02:46.338993 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 669/1360] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:03:49.895676 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:03:49.896455 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 17:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:04:38.784471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:04:38.784471 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG dbcounter [-] [133198] Writing DB stats nova_cell1:SELECT=62 {{(pid=133198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:04:38.785167 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:38.785835 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:38.790862 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_api:SELECT=24 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:04:38.791611 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:38.792097 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:38.792565 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:38.792738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG dbcounter [-] [133199] Writing DB stats nova_cell1:SELECT=48 {{(pid=133199) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:04:38.793265 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:38.793721 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:38.796724 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:38.826209 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Going to try to terminate instance {{(pid=133198) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:04:38.859771 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-8a7218e7-920a-4472-9b90-a7a19013bead req-afb95485-094a-4c09-803c-99e592b4b7af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ede4e6b-e5af-4ca9-8b10-275d4819818b", "tag": "c54d7558-ae94-4078-8e1a-711090d12c74"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:04:38.871547 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-8a7218e7-920a-4472-9b90-a7a19013bead req-afb95485-094a-4c09-803c-99e592b4b7af service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:38.872026 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-8a7218e7-920a-4472-9b90-a7a19013bead req-afb95485-094a-4c09-803c-99e592b4b7af service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:38.872499 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-8a7218e7-920a-4472-9b90-a7a19013bead req-afb95485-094a-4c09-803c-99e592b4b7af service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:38.883304 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-8a7218e7-920a-4472-9b90-a7a19013bead req-afb95485-094a-4c09-803c-99e592b4b7af service nova] Creating event network-changed:c54d7558-ae94-4078-8e1a-711090d12c74 for instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b on hv-cinder-85032 Aug 23 17:04:38.889872 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-8a7218e7-920a-4472-9b90-a7a19013bead req-afb95485-094a-4c09-803c-99e592b4b7af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105292 Aug 23 17:04:38.890208 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 670/1361] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:04:39.218408 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-0cdc828c-c07a-464d-8af1-45ff28735402 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 204 len: 0 microversion: 2.1 time: 0.439275 Aug 23 17:04:39.219247 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 692/1362] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 17:04:38 2022] DELETE /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:04:39.229664 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:39.230436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:39.237042 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:39.237676 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:39.238264 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:39.239143 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:39.239590 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:39.240002 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:39.372001 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:04:39.379738 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-f367ac05-6958-4b03-98ca-f5aaeeb6541b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1576 microversion: 2.1 time: 0.155848 Aug 23 17:04:39.380735 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 671/1363] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:39 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:04:40.402358 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:40.403069 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:40.409488 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:40.410009 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:40.410459 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:40.411155 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:40.411614 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:40.412046 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:40.562509 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:04:40.570180 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-cf93adf3-12f2-4255-9220-0e434554a79a tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1576 microversion: 2.1 time: 0.172045 Aug 23 17:04:40.570746 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 693/1364] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:40 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:04:41.591781 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:41.592436 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:41.598929 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:41.599399 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:41.599823 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:41.600536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:41.600976 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:41.601452 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:41.797450 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [req-a5922fc6-1320-48cf-8206-b7b8e8514918 req-17804d32-aa99-458c-a3e3-f624308fc4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ede4e6b-e5af-4ca9-8b10-275d4819818b", "name": "network-vif-deleted", "tag": "c54d7558-ae94-4078-8e1a-711090d12c74"}]} {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:04:41.808653 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-a5922fc6-1320-48cf-8206-b7b8e8514918 req-17804d32-aa99-458c-a3e3-f624308fc4b3 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:41.809067 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-a5922fc6-1320-48cf-8206-b7b8e8514918 req-17804d32-aa99-458c-a3e3-f624308fc4b3 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:41.809498 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [req-a5922fc6-1320-48cf-8206-b7b8e8514918 req-17804d32-aa99-458c-a3e3-f624308fc4b3 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:41.820919 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.compute.server_external_events [req-a5922fc6-1320-48cf-8206-b7b8e8514918 req-17804d32-aa99-458c-a3e3-f624308fc4b3 service nova] Creating event network-vif-deleted:c54d7558-ae94-4078-8e1a-711090d12c74 for instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b on hv-cinder-85032 Aug 23 17:04:41.821381 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:04:41.826004 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [req-a5922fc6-1320-48cf-8206-b7b8e8514918 req-17804d32-aa99-458c-a3e3-f624308fc4b3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032208 Aug 23 17:04:41.826592 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 694/1365] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:04:41.830827 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-ab884282-80ef-4bc1-ae25-b2fc0f60f4ba tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1458 microversion: 2.1 time: 0.243532 Aug 23 17:04:41.831388 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 672/1366] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:41 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1458 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:04:42.856436 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:42.857138 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:42.863493 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:42.863973 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:42.864586 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:42.866656 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:42.867117 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:42.867550 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:42.896992 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:42.897475 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:42.897912 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:42.898353 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.objects.instance [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lazy-loading 'fault' on Instance uuid 2ede4e6b-e5af-4ca9-8b10-275d4819818b {{(pid=133198) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:04:42.939953 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:04:42.947715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-4be852c7-a385-4784-b063-2804c7bbbbf6 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 200 len: 1230 microversion: 2.1 time: 0.096422 Aug 23 17:04:42.948298 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 695/1367] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:42 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:04:43.967404 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:43.968004 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 2ede4e6b-e5af-4ca9-8b10-275d4819818b] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:43.974459 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:43.974941 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:43.975428 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:43.976113 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:43.976591 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:43.977017 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:43.990343 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] HTTP exception thrown: Instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b could not be found. Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Request method failure captured: Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b HTTP/1.1 Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQbRuNrkpmxSrmMye6rXa-h4jzxe5FgB0K0iMta60oX3cSQq-Sruk8LZ3aTJPlBo_-uj3ekJKX-LTEyaf__GVb0_Vw0kmeiZ_FtMqXThW36B2XptRWza6R3hijn3D8A3WAbwZ4Exv5oRQjEyb7x8A8NNPX5bmS6w2ADPpp1GwMpA7N0 Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 17:04:43.991988 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_466ef52107794f6a9b6cc8ce7ced20f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 68fb84a5e5514ef4a008e978d128ebaf Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b could not be found. Aug 23 17:04:43.993692 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': '2ede4e6b-e5af-4ca9-8b10-275d4819818b'} Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b could not be found. Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:04:43.995238 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b could not be found. Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b could not be found. Aug 23 17:04:43.996968 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:43.998545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Returning 404 to user: Instance 2ede4e6b-e5af-4ca9-8b10-275d4819818b could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:04:43.998545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5f823339-5679-4d45-9090-9923a7905181 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b" status: 404 len: 111 microversion: 2.1 time: 0.029887 Aug 23 17:04:43.998545 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 673/1368] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:43 2022] GET /compute/v2.1/servers/2ede4e6b-e5af-4ca9-8b10-275d4819818b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:04:47.584638 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:47.585699 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:47.588192 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-9752448b-59e0-46c7-bd2d-c9e7f89bbe5d req-a697c5c2-1ca8-4c04-8df1-c639b0fade8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38b05fee-0492-49c9-9201-68f5a0b9e719", "tag": "e9b048ae-caeb-4527-861e-ace275773ea4"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:04:47.592356 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:47.592849 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:47.593284 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:47.593979 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:47.594642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:47.595068 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:47.606231 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-9752448b-59e0-46c7-bd2d-c9e7f89bbe5d req-a697c5c2-1ca8-4c04-8df1-c639b0fade8e service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:47.606704 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-9752448b-59e0-46c7-bd2d-c9e7f89bbe5d req-a697c5c2-1ca8-4c04-8df1-c639b0fade8e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:47.607249 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-9752448b-59e0-46c7-bd2d-c9e7f89bbe5d req-a697c5c2-1ca8-4c04-8df1-c639b0fade8e service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:47.620105 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-9752448b-59e0-46c7-bd2d-c9e7f89bbe5d req-a697c5c2-1ca8-4c04-8df1-c639b0fade8e service nova] Creating event network-changed:e9b048ae-caeb-4527-861e-ace275773ea4 for instance 38b05fee-0492-49c9-9201-68f5a0b9e719 on hv-cinder-85032 Aug 23 17:04:47.621431 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Going to try to terminate instance {{(pid=133198) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:04:47.625245 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-9752448b-59e0-46c7-bd2d-c9e7f89bbe5d req-a697c5c2-1ca8-4c04-8df1-c639b0fade8e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041634 Aug 23 17:04:47.626207 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 674/1369] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:04:47.927022 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-40082820-8435-4d2d-8f6f-c01962e12977 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "DELETE /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 204 len: 0 microversion: 2.1 time: 0.345780 Aug 23 17:04:47.927727 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 696/1370] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 17:04:47 2022] DELETE /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:04:47.937134 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:47.940883 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:47.945053 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:47.945418 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:47.946034 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:47.946745 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:47.947240 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:47.948707 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:48.093358 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:04:48.101490 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-22dd1991-df4e-4f11-8f49-5eeab2d1e446 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1577 microversion: 2.1 time: 0.168686 Aug 23 17:04:48.102108 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 675/1371] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:47 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:04:49.125281 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:49.125897 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:49.132334 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:49.132844 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:49.133276 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:49.133959 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:49.134666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:49.135096 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:49.524157 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:04:49.532557 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-1c862c76-2dee-4599-ab16-d697cd434f59 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1577 microversion: 2.1 time: 0.411522 Aug 23 17:04:49.533119 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 697/1372] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:49 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1577 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:04:50.276671 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [req-5305a575-81ef-4fc1-ba2c-81fa35c3b454 req-456ff32a-a7d3-4f90-a4ef-404c94b580a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38b05fee-0492-49c9-9201-68f5a0b9e719", "name": "network-vif-deleted", "tag": "e9b048ae-caeb-4527-861e-ace275773ea4"}]} {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:04:50.286336 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-5305a575-81ef-4fc1-ba2c-81fa35c3b454 req-456ff32a-a7d3-4f90-a4ef-404c94b580a8 service nova] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:50.286814 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-5305a575-81ef-4fc1-ba2c-81fa35c3b454 req-456ff32a-a7d3-4f90-a4ef-404c94b580a8 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:50.288698 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [req-5305a575-81ef-4fc1-ba2c-81fa35c3b454 req-456ff32a-a7d3-4f90-a4ef-404c94b580a8 service nova] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:50.297922 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.compute.server_external_events [req-5305a575-81ef-4fc1-ba2c-81fa35c3b454 req-456ff32a-a7d3-4f90-a4ef-404c94b580a8 service nova] Creating event network-vif-deleted:e9b048ae-caeb-4527-861e-ace275773ea4 for instance 38b05fee-0492-49c9-9201-68f5a0b9e719 on hv-cinder-85032 Aug 23 17:04:50.302835 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [req-5305a575-81ef-4fc1-ba2c-81fa35c3b454 req-456ff32a-a7d3-4f90-a4ef-404c94b580a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030403 Aug 23 17:04:50.303413 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 676/1373] 10.222.0.52 () {64 vars in 1317 bytes} [Tue Aug 23 17:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:04:50.553444 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:50.554057 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:50.560513 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:50.560998 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:50.561430 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:50.562118 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:50.562570 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:50.562990 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:50.628977 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.policy [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133198) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:04:50.637650 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-dd2e8afe-3146-4e6a-8a50-a2f94a5749b4 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1225 microversion: 2.1 time: 0.087945 Aug 23 17:04:50.638224 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 698/1374] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:50 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:04:51.658677 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:51.659368 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:51.665462 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:51.666610 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:51.667038 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:51.667721 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:51.668245 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:51.668600 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:51.699815 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:51.700320 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:51.700746 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:51.701179 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.objects.instance [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lazy-loading 'fault' on Instance uuid 38b05fee-0492-49c9-9201-68f5a0b9e719 {{(pid=133199) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:04:51.743326 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.policy [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68fb84a5e5514ef4a008e978d128ebaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '466ef52107794f6a9b6cc8ce7ced20f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133199) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:04:51.750447 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-5162c809-96d7-4af3-98ad-5f11892335b0 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 200 len: 1184 microversion: 2.1 time: 0.096359 Aug 23 17:04:51.751014 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 677/1375] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:51 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 1184 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:04:52.771991 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:52.772642 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: 38b05fee-0492-49c9-9201-68f5a0b9e719] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:52.779077 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:52.779612 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:52.780053 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:52.780778 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:52.781235 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:52.781666 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:52.795791 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] HTTP exception thrown: Instance 38b05fee-0492-49c9-9201-68f5a0b9e719 could not be found. Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Request method failure captured: Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 HTTP/1.1 Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQbRuNrkpmxSrmMye6rXa-h4jzxe5FgB0K0iMta60oX3cSQq-Sruk8LZ3aTJPlBo_-uj3ekJKX-LTEyaf__GVb0_Vw0kmeiZ_FtMqXThW36B2XptRWza6R3hijn3D8A3WAbwZ4Exv5oRQjEyb7x8A8NNPX5bmS6w2ADPpp1GwMpA7N0 Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 17:04:52.797512 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_466ef52107794f6a9b6cc8ce7ced20f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 68fb84a5e5514ef4a008e978d128ebaf Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance 38b05fee-0492-49c9-9201-68f5a0b9e719 could not be found. Aug 23 17:04:52.799105 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': '38b05fee-0492-49c9-9201-68f5a0b9e719'} Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38b05fee-0492-49c9-9201-68f5a0b9e719 could not be found. Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:04:52.800258 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38b05fee-0492-49c9-9201-68f5a0b9e719 could not be found. Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38b05fee-0492-49c9-9201-68f5a0b9e719 could not be found. Aug 23 17:04:52.801652 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:52.802879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Returning 404 to user: Instance 38b05fee-0492-49c9-9201-68f5a0b9e719 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:04:52.802879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-28d3d6ad-7749-4838-867c-ed3f6eeb5570 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719" status: 404 len: 111 microversion: 2.1 time: 0.030849 Aug 23 17:04:52.802879 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 699/1376] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:52 2022] GET /compute/v2.1/servers/38b05fee-0492-49c9-9201-68f5a0b9e719 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:04:53.289520 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:53.294230 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.compute.api [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133199) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:53.296536 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:53.297021 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:53.297457 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:53.298145 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:53.298598 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:53.299022 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG oslo_concurrency.lockutils [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:53.312340 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.wsgi [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] HTTP exception thrown: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Request method failure captured: Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: request: DELETE /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 HTTP/1.1 Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept: application/json Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Accept-Encoding: identity Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Connection: close Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Length: 0 Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Content-Type: application/json Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Host: 10.222.0.52 Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Openstack-System-Scope: None Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: User-Agent: python-urllib3/1.26.11 Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Auth-Token: gAAAAABjBQbRuNrkpmxSrmMye6rXa-h4jzxe5FgB0K0iMta60oX3cSQq-Sruk8LZ3aTJPlBo_-uj3ekJKX-LTEyaf__GVb0_Vw0kmeiZ_FtMqXThW36B2XptRWza6R3hijn3D8A3WAbwZ4Exv5oRQjEyb7x8A8NNPX5bmS6w2ADPpp1GwMpA7N0 Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Id: None Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Domain-Name: None Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Identity-Status: Confirmed Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Is-Admin-Project: True Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Id: default Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Domain-Name: Default Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Project-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Role: member,reader Aug 23 17:04:53.313980 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Roles: member,reader Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_466ef52107794f6a9b6cc8ce7ced20f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-Tenant-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Id: default Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Domain-Name: Default Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Id: 68fb84a5e5514ef4a008e978d128ebaf Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: X-User-Name: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: method: > Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: exception: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.315691 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: action_args: {'id': 'aaaada4d-42af-4baa-9084-bcbca838a4d0'} Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:04:53.316589 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.317960 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.319348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Returning 404 to user: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. {{(pid=133199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:04:53.319348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-c0dc7c9e-0b9a-412f-a070-1f3e88889140 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 404 len: 111 microversion: 2.1 time: 0.029779 Aug 23 17:04:53.319348 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 678/1377] 10.222.0.52 () {58 vars in 1239 bytes} [Tue Aug 23 17:04:53 2022] DELETE /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:04:53.324981 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '>' {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:53.325587 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.compute.api [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] [instance: aaaada4d-42af-4baa-9084-bcbca838a4d0] Fetching instance by UUID {{(pid=133198) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:04:53.331373 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:53.331846 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:53.332312 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:53.332989 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Acquiring lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:04:53.333435 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:04:53.333863 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG oslo_concurrency.lockutils [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Lock "62a6c2c5-851c-4c7c-9543-0f10cb93bbf8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:04:53.347346 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.wsgi [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] HTTP exception thrown: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Request method failure captured: Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: request: GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 HTTP/1.1 Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept: application/json Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Accept-Encoding: identity Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Connection: close Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Length: 0 Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Content-Type: application/json Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Host: 10.222.0.52 Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Openstack-System-Scope: None Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: User-Agent: python-urllib3/1.26.11 Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Auth-Token: gAAAAABjBQbRuNrkpmxSrmMye6rXa-h4jzxe5FgB0K0iMta60oX3cSQq-Sruk8LZ3aTJPlBo_-uj3ekJKX-LTEyaf__GVb0_Vw0kmeiZ_FtMqXThW36B2XptRWza6R3hijn3D8A3WAbwZ4Exv5oRQjEyb7x8A8NNPX5bmS6w2ADPpp1GwMpA7N0 Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Id: None Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Domain-Name: None Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Identity-Status: Confirmed Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Is-Admin-Project: True Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Id: default Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Domain-Name: Default Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Project-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Role: member,reader Aug 23 17:04:53.348842 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Roles: member,reader Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_466ef52107794f6a9b6cc8ce7ced20f7", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/466ef52107794f6a9b6cc8ce7ced20f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}] Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Id: 466ef52107794f6a9b6cc8ce7ced20f7 Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-Tenant-Name: tempest-TestVolumeBootPattern-1278385748 Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Id: default Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Domain-Name: Default Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Id: 68fb84a5e5514ef4a008e978d128ebaf Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: X-User-Name: tempest-TestVolumeBootPattern-1278385748-project Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: method: > Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: exception: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.350541 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: action_args: {'id': 'aaaada4d-42af-4baa-9084-bcbca838a4d0'} Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: {{(pid=133198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:04:53.351715 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. Aug 23 17:04:53.353744 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: ERROR nova.api.openstack.wsgi Aug 23 17:04:53.355390 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: DEBUG nova.api.openstack.wsgi [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Returning 404 to user: Instance aaaada4d-42af-4baa-9084-bcbca838a4d0 could not be found. {{(pid=133198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:04:53.355390 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO nova.api.openstack.requestlog [None req-9ef146df-4b7d-49d4-961b-5e1fe56ba67b tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0" status: 404 len: 111 microversion: 2.1 time: 0.029459 Aug 23 17:04:53.355390 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: [pid: 133198|app: 0|req: 700/1378] 10.222.0.52 () {58 vars in 1236 bytes} [Tue Aug 23 17:04:53 2022] GET /compute/v2.1/servers/aaaada4d-42af-4baa-9084-bcbca838a4d0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:04:54.844518 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: DEBUG nova.api.openstack.wsgi [None req-b7ed610b-b135-4685-9f63-69dca5f4a835 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] Calling method '.version_select at 0x7f677c985430>' {{(pid=133199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:04:54.926686 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO nova.api.openstack.requestlog [None req-b7ed610b-b135-4685-9f63-69dca5f4a835 tempest-TestVolumeBootPattern-1278385748 tempest-TestVolumeBootPattern-1278385748-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1060161497" status: 202 len: 0 microversion: 2.1 time: 0.086070 Aug 23 17:04:54.927273 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: [pid: 133199|app: 0|req: 679/1379] 10.222.0.52 () {58 vars in 1263 bytes} [Tue Aug 23 17:04:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1060161497 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:05:23.122477 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:05:23.123126 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Tue Aug 23 17:05:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:05:32.331330 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:05:32.332009 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Tue Aug 23 17:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:07:09.903943 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:07:09.904632 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 17:07:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:07:10.240938 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:07:10.241142 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 17:07:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:07:23.259658 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:07:23.260324 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Tue Aug 23 17:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:07:32.703491 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:07:32.704122 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 17:07:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:08:43.131203 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:08:43.131857 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Tue Aug 23 17:08:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:08:52.338976 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:08:52.339720 dv-cinder-850320-6-iscsi devstack@n-api.service[133198]: Tue Aug 23 17:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:10:29.913712 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:10:29.914302 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 17:10:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 17:10:30.248483 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 17:10:30.248731 dv-cinder-850320-6-iscsi devstack@n-api.service[133199]: Tue Aug 23 17:10:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!